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ABSTRACT 



The graphical control system of the present invention 
includes a computer (20), a device interface (35) for a 
non-computer system device (21) having at least one feature 
control (29a) (or display (29b)), a bus network (28) con- 
necting the conr^uter (20) to die device inteiface (35). and 
a visual network operating system (78) based on an object- 
oriented programming paradigm. The device interface (35) 
connects the non-computer system device (21) to the bus 
network (28) and provides the medianism for converting 
computer-generated commands into signals for controlling 
the operation of the feature control (29a) of the non- 
coniputer system device (21). The visual network operating 
system (78) is a distributed operating system that is partially 
stored on the con^uter (20) and partially stored in the device 
interface (35). A con^Kiter portion causes the conq)uter (20) 
to generate or create a visual device control (40) that 
graphically replicates the feature control (29a) normally 
associated with the non-computer system device (21). The 
visual device control (40) is operated by a conventional 
gr^hical control device, such as a mouse (32), track ball, 
touch saeen, joystick, etc. As the replicated controls are 
operated, the computer (20) sends messages to the device 
interfaces (35). which cause the feature control (29a) of the 
non-computer system device (21) to respond in the same 
way it would have responded had the feature control been 
operated manually, electrically or effected by another com- 
puter on die bus network (28). 

74 Claims, 20 Drawing Sheets 
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METHOD AND APPARATUS FOR 
CONTROLLING NON-COMPUTER SYSTEM 
DEVICES BY MANIPULATING A 
GRAPHICAL REPRESENTATION 

RELAnONSHIP TO OTHER APPUCAnONS 

This s^plication is a continuation-in-part of U.S. patent 
appUcation Ser. No. 08/307,864, filed Sep. 16, 1994, now 
abandoned as of Dec. 26, 1995 and entitled A Me&od and 
Apparatus for Controlling Non-Conq)uter System. Devices 
By Manipulating a Gr^hical Representation. The subject 
matter of application Ser. No. 0^307,864 is incorporated 
herein by reference. 

FIELD OF THE INVENTION 

This invention generally relates to a method and apparatus 
for using a computer to control non-computer system 
devices connected to the computer. 

BACKGROUND OF THE INVENTEON 

Object-oriented programming paradigms have become an 
inaeasingly common tool in computer programming. Such 
paradigms are often enq>loyed by graphical user interfaces, 
where conqxiter system elements are visually represented 
and manipulated by visible screen entities sudi as icons on 
a computCT screen or other display device. For programming 
purposes, "objects" are used to represent (he manipulatable 
computer system elements by containing methods and data 
that define those elements. By representing such con^uter 
system elements as objects, it is unnecessary for the pro- 
grammer to generate a spedfic set of code for each computer 
system element. Rather, the programmer can define classes 
of objects and assign certain universal behaviors to each 
class. Computer system elements that can be represented by 
objects include computer peripherals and computer applica- 
tion programs. Exanq)les of application programs are 
spreadsheets, word processing programs, database 
programs, etc. 

In graphical user interfaces employing an object-oriented 
programming paradigm, application programs are typically 
represented to a user by an icon displayed within a window 
on a computer screen, one icon for eadi application program 
that can be run. Execution of an application program is 
initiated by selecting its corresponding icon, most often 
using a pointing device such as a mouse. When an applica- 
tion program is selected, a message is sent to the corre- 
sponding application program object, indicating that the 
application program object is to invoke certain of its meth- 
ods. For example, if a word processing program is selected, 
the methods contained within the application program object 
may include starting the word processing program. The user 
may also "drag'* icons from one area of the screen to another, 
or from one window to another using the mouse. The user 
may even "drag" one icon representative of an application 
object and "drop" that icon on top of another. This "object- 
object" interaction will result in a combination of applica- 
tion objects. For example, if a word processing document 
icon is dropped upon a word processing program icon, the 
object-object interaction results in starting the word process- 
ing program and causing that program to open the word 
processing document. This is possible because both the word 
processing program and the word processing document have 
been represented as compatible application program objects. 
Hence, the icons in the object-oriented programming para- 
digm allow the user to graphically control various computer 
system elements and the interrelationships between com- 
puter system elements. 
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While the conventional object-oriented, graphical user 
interface described above has been used to allow a user to 
initiate execution of such computer system elements as 
applications programs, use of object-oriented programming 

5 paradigms to graphically control and monitor non-computer 
system devices has been severely limited. Non-computer 
system devices include virtually any electronic device 
equipped with the necessary hardware to be connected to a 
personal computer either direcdy or via a network. For 
exanq}le, non-computer system devices may include lamps, 
television sets, VCRs, video cameras, telephones, 
amplifiers, CD players, equalizers, etc. Such devices typi- 
cally come equipped with a variety of feature controls and 
displays for operation including volume controls, power 
switches, input and output nneters, channel selectors, etc. In 

15 order to control a non-conq)Uter system device using a 
graphical user interface, in the past, each feature control 
(e.g., a volume control) or feature display (e.g., an output 
meter) that is to be manipulated by the user has been coupled 
to the graphical user interface computer by specially 

20 designed software, resulting in a visible screen entity for 
each feature control of the device being displayed on the 
computer saeen. 

Conventionally, non-computer system devices have been 
graphically represented and controlled via a special program 

25 designed specifically for each device, where the specially 
designed program is either built into die computer operating 
system or loaded into the conq)uter operating system as an 
add-on software product For example, the CD Remote 
program, Version 1.3 for the Macintosh coiiq)uter provides 

30 the corc^uter user with a graphic interface for controlling a 
Macintosh CD player hardwired to the computer. The user is 
provided with a graphical display of the CD player's control 
panel, complete with graphical stop, play, pause, skip, etc. 
controls. To initiate execution of any one of these commands 

35 upon the CD player, the user merely selects the correspond- 
ing graphical control using the mouse. Unlike graphical user 
interface programs for controlling applications programs, 
the graphical controls are not visible screen entities that the 
user can "drag and drop" or "cut and paste" into other areas 

40 of the screen, into other windows, or on top of one another. 
Instead, the placement, position and execution of each of the 
graphical controls is predefined by the specially designed 
CD Remote program for the CD player. 
In contrast to the Macintosh CD player, non-computer 

45 system devices are normally not used alone. Instead, non- 
computer system devices are used in combination with other 
non-con^uter system devices. For example, a stereo system 
often comprises at least a CD player, an equalizer and an 
amplifier, each of which may be made by the same or a 

SO different manufacturer. In order to use a personal computer 
to operate an entire stereo system udng the approach 
employed by the CD Remote program referred to above, 
each stereo system device would be necessarily be hard- 
wired to the personal computer and a specially designed 

55 program comprising specific sets of code would be neces- 
sary for controlling each device, each feature control, and 
ead) feature display on eadi device, and for controlling the 
relationships between the devices and the feature controls 
and displays. In addition, the code would have to be spe- 

60 dally designed for eadi manufacturer's device. Even if the 
devices were connected to the personal con^uter via a 
network as opposed to directly hardwired, specialized code 
would still be required to control each device because, prior 
to the present invention, a graphic user interface eoq)loying 

65 an object-oriented programming paradigm for controlling 
stereo devices produced by varying manufacture's did not 
exist 
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Accordingly, thexe is a need for a graphical control system 
for controlling non-computer system devices and the rela- 
tionships between those devices. In order to eliminate the 
need for specially designed code for each device, such a 
graphical control system should employ a common para- 
digm for representing the non-computer system devices to 
be controlled. In addition, the graphical control system 
should provide for dynamic visual device controls that 
represent each feature control of a device and allow a user 
to graphically control and monitor each device without 
having any specific knowledge about the device and without 
making any physical contact with the device. The present 
invention is directed to providing such a graphical control 
system. 

SUMMARY OF THE INVENTION 

In accordance with this invention, a graphical control 
system for controlling non-computer system devices is pro- 
vided. Non-computer system devices are devices that can be 
electronically controlled such as musical an^jliiiers and 
equalizers, television sets, VCRs, video cameras, etc. Vir- 
tually any electronic device equipped with the necessary 
hardware to be either directly or indirectly controlled by a 
computer, including a simple on/off switch, can form a 
non-computer system device. The graphical control system 
includes a computer, an interface(s) for a non-computer 
system device(s) having at least one feature control, a 
coupling medium for coupling the computer to the interface 
(s) and a visual network operating system (VNOS). The 
coupling medium can be a bus network or siinply a point- 
to-point connection between a computer and a single non- 
computer system device. Various typed of bus networks can 
be used including fiber optics, co-axial cable and twisted 
wire pair. The coupling medium could also include a radio 
frequency coupling medium, such as a radio frequency 
coupling network. The interface(s) connects the non- 
computer system device(s) to the bus network and provides 
the mechanism for converting computer-generated com- 
mands into signals for controlling the operation of the 
non-computer system devices. 

The visual network operating system (VNOS) is a dis- 
tributed operating system that is partially stored in a com- 
puter and partially stored in the intCTface(s). The major 
portion is stored in the computer. The computer portion 
causes the computer to generate or create graphical controls 
that represent the type of featmre controls normally associ- 
ated with the non-computer system devices connected to the 
•network. For example, in the case of a musical amplifier, 
such controls may include an on/off switch, an input meter 
and a volume control. An equalizer would include boost and 
cut controls for frequency bands. The graphical controls are 
operated by a conventional graphical control device, such as 
a mouse, track ball, touch screen, joystick, etc. As the 
graphical controls are operated, the computer sends mes- 
sages to the interface(s), which cause the non-computer 
system devices to respond in the same way the devices 
would have responded to the manual or electrical operation 
of the equivalent feature controls. 

In accordance with other aspects of this invention, the 
visual network operating system (VNOS) is based on an 
object-oriented programming paradigm in which objects are 
interoperable and are organized into classes in a hierarchical 
fashion. 

In accordance with further aspects of this invention, five 
different types of objects are employed by the invention. 
They are: window objects; visual reference objects; value 



,221 

4 

control element (VCE) objects; device objects; and packet 
objects. Window objects contain the data and methods 
necessary for displaying a window on the screen of the 
computer display. Visual reference objects contain the meth- 
5 ods and data necessary for displaying and associating icons 
and visual device controls (VDCs) with a window object A 
VCE object contains a value represented by the VDC and 
controlled by setting the VDC, and methods for manipulat- 
ing the value. A device object contains the methods and data 
10 for communicating witii particular types of non-computer 
system devices and for managing a graphical representation 
of a non-computer system device. Packet objects contain the 
methods and data for communicating data between the 
computCT and non-computer system devices via the network. 
15 In accordance with yet other aspects of this invention, the 
window, visual reference, VCE, device, and packet objects 
are subdivided into lower order subclasses. 

As can be readily appreciated from the foregoing 
summary, the invention provides a graphical control system 
for controlling a wide variety of non-computer system 
devices. Virtually any electronic device equipped with the 
necessary hardware can be controlled. The graphical control 
system creates visual device controls that represent the 
feature controls and feature displays noimally associated 
^ with the non-computer system device that is to be controlled. 
The visual device controls are operated by a conventional 
user manipulation device, sudi as a mouse, track ball, touch 
screen, joystick, etc. The invention eliminates the need for 
specially designed code for each non-computer system 
device by employing an object-oriented paradigm to repre- 
sent the non-computer system devices. While the invention 
is designed for use, in part, in the forward direction wherein 
the computer controls non-computer system devices, in 

some versions of the invention it is desirable for the non- 
35 

computer system devices to be subject to manual or elec- 
trical control, monitoring, or control by another computer. In 
such cases data representing control changes arc sent from 
the non-computer system devices and/or other computers to 
all other non-computer devices and personal computers on 
^ the network which store object data related to the control 
being changed As a result, any associated visual device 
control is updated and monitored 

BRIEF DESCRDPTION OF THE DRAWINGS 

45 

The foregoing aspects and many of the attendant advan- 
tages of this invention will become more readily appreciated 
as the same becomes better understood by reference to the 
following detailed description, when taken in conjunction 
50 with the accompanying drawings, wherein: 

FIG. 1 is a pictorial diagram of a preferred embodiment 
of a graphical control system formed in accordance with the 
present invention that includes a personal computer, a bus 
network and a plurality of devices controlled by a graphical 
55 control program incorporated in the personal computer; 

FIG. 2 is a block diagram of the personal computer, 
devices and bus network shown in FIG. 1; 

FIG. 3 is an isometric view of an aiiq)lifier; 
gQ FIG. 4 is an isometric view of a typical personal computer 
suitable for use in the graphical control system shown in 
FIG. 1; 

FIG. 5 is a block diagram of several components of the 
personal computer shown in FIG. 4 that are used by the 
65 graphical control system of the present invention; 

FIG. 6 illustrates a typical Amplifier Panel window pro- 
duced by the graphical control system shown in FIG. 1; 



04/23/2004, EAST Version: 1.4.1 



5,6t 

5 

FIG. 7 is a flow chart illustratiDg the functions provided 
by the graphical control system shown in FIG. 1; 

FIG. 8 is a graphical rqiresentation of an object imple- 
mented in the graphical control system shown in FIG. 1; 

FIG. 9A is a hierarchical diagram of an object-oriented 
programming paradigm implemented in the graphical con- 
trol system shown in FIG. 1; 

FIG. 9B illustrates the methods and data provided by the 
object-oriented programming paradigm depicted in FIG. 8; 

FIG. 10 illustrates the flow of messages between instances 
of objects when the grajAical control system shown in FIG. 
1 first encounters a device on the network; 

FIG. 11 illustrates the flow of messages between instances 
of objects when the gra]^cal control system shown in FIG. 
1 enables a user to control a device; 

FIG. 12 illustrates the flow of messages between instances 
of objects when the graphical control system shown in FIG. 
1 enables a user to create a cloned visual device control; 

FIG. 13 illustrates the flow of messages between instances 
of objects when the graphical control system shown in FIG. 
1 automatically regenerates operable dimensions of a visual 
device control; 

FIGS. 14, 15 and 16 illustrate the flow of messages 
between instances of objects when the graphical control 
system shown in FIG. 1 enables a user to control a plurality 
of devices with a single visual device control; 

FIG. 17A is a hierarchical diagram of an object-oriented 
programming paradigm implemented in a device as part of 
the graphical control system shown in FIG. 1 provided by a 
device; 

FIG. 17B illustrates the methods and data provided by the 
object-oriented programming paradigm depicted in FIG. 
17A; and 

FIG. 18 illustrates the flow of messages between instances 
of objects when the graphical control system shown in FIG. 
1 effectuates a device controL 

DETAILED DESCRIFTION OF THE 
PREFERRED EMBODIMENT 

As will be better understood from the following 
description^ the present invention is directed to a gr^^hical 
control system for controlling non-computer system devices, 
wherein virtually any electronically controllable device 
equipped with flie necessary interface hardware can be 
controlled. While the following description explains the 
invention in connection with musical system components, 
such as ampliflers and equalizers, it is to be understood that 
the invention can be used with other non-conq>uter system 
devices, including a simple on/off switch for controlling a 
lamp. In addition, the invention easily accommodates non- 
computer system devices produced by various manufactur- 
ers. The invention employs a personal computer, a network, 
interfaces for connecting the computer and the non- 
computer system devices to the network, and a visual 
network operating system. While the preferred netw<ffk is a 
bus network, such as a fiber optic bus, other types of 
networks, including non-wired networks can be employed in 
actual embodiments of the invention. Further, the network 
can simply be a point-to-point connection for connecting a 
computer to the interface of a single non-con^uter system 
device. The visual network (^erating system, which controls 
the operation of the con^uter and the interface is based on 
an object-oriented programming paradigm. In order to better 
understand the preferred embodiment of the invention 
described below, certain aspects of object-oriented program- 



)7,221 

6 

ming paradigms that are relevant to the following discussion 
are fi^ described. 

The fundamental aspects of object-oriented progranmiing 
paradigms are that objects can be organized into classes in 

^ a hi^mchical fashion and that objects are interoperable. 
Qasses are abstract generic descriptions of objects and flieir 
behaviors. A dass defines a certain category or grouping of 
methods and data within an d>ject. Methods comprise, 
procedures or code that operate upon data. Methods as 

10 applied to data define the behavior of the object Refinement 
of the methods of the dass is achieved by the creation of 
"sub-das ses." In other words, a dass can be thought of as a 
genus, and its subclass as the spedes. Subclasses allow the 
introduction of a new dass into the dass hierardiy, and 

1^ inherit the behaviors of its superclass while adding new 
behaviors to the subdass. 

An instance of a class is a specific individual entity, 
something concrete having observable behavior. An instance 
is a specific object with the behaviors defined by its dass. 
Instances are aeated and deleted dynamically in an objec^ 
oriented programming paradigm- The class, howevCT, is the 
broad, yet abstract, concept under which the instance 
belongs. The instance inherits all the methods of its dass, 
but has particular individual values assodated with it that 
are unique. There is only one location in the memory of a 
computer for the class. There may, however, be numerous 
instances of the class, each of which has different values and 
different physical locations in memory. 

^ FIG. 1 illustrates a bus network 28 interconnecting a 
personal con^)Uter 20 and a plurality of non-computer 
system devices 21. The gr^hical control system of the 
present invention enq)loying the object-oriented program- 
ming paradigm as described above allows a user to use the 

35 personal computer 20 to control the operation of the non- 
computer system devices 21 via bus network 28. For ease of 
illustration only tiiree non<omputer system devices 21 are 
shown in FIG. 1. The illustrated devices are a two-channel 
amplifier 22, a tuner 24 and a graphic equalizer 26. As wiU 

^ be appredated by those of ordinary skill in the art from the 
following description, additional non-computer system 
devices can be connected to and controlled by personal 
con^uter 20 via the bus network 28, if equipped with the 
necessary interface hardware. Non-computer system devices 

^5 may include video cameras, speakers, television sets, 
telephones, lamps, etc. Even simple light switches can form 
non-computer system devices. For illustrative purposes 
only, the devices shown in FIG. 1 are depicted as audio 
sound system devices, Le., amplifiers, equalizers, tuners, eta 

50 In addition, those of ordinary skill in the art will recognize 
that additional personal computers equipped with die nec- 
essary hardware interfaces may be connected to bus network 
28 and sinmltaneously used to the control non-computer 
system devices 21. In fact, any computer system induding 

35 but not limited to portable computers, poweibooks, personal 
device assistants that is equipped with the necessary hard- 
ware interface to be connected to bus network 28 or any 
other coupling medium may be used control the non- 
computer system devices 21. 

60 

Inter-Device Communication 

As shown in FIG. 2, the personal computer 20 is con- 
nected to the network 28 by way of an RS232 interface 42 
and a bridge 45. Standard personal computen ^ically 
65 indude an RS232 card 43 and an RS232 cable 44 for 
communicating with external devices such as printers. 
RS232 is an interface standard that specifies signal voltage 
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levels, etc. RS232 is also a byte-level commiimcation pro- cables are highly immune to electromagnetic interference 

tocol that specifics start bits, stop bits, etc. for sending bytes and are capable of carrying signals over long distances 

of data. Generally* a higher level communication protocol is without significant attenuation. As described herein, the bus 

used on top of the RS232 byte-level communication network 28 represents fiber optic cables. Accordingly, the 
protocol, i.e., the personal computer 20 includes software 5 I/O board 47 of interface 35 shown in FIG. 2 is constructed 

defining a point-to-point communication protocol that is for use with fiber optic cables. 

used on top of the RS232 byte-level protocol. The bridge 45 Various network communication protocols can be used to 

provides the interface between the 1^5232 cables 38 and the communicate over the bus network 28. In one actual 

bus network 28, on which a network communication pro- embodiment of the present invention, fee network commu- 
tocol is used. lo nication protocol used to communicate over the bus network 

Also depicted in FIG. 2 are the same non-computer 28 is of the type disclosed in commonly assigned U.S. Pat 

system devices 21 shown in FIG. 1. Each non-computer No. 5245,604, entitled "Communication System," the dis- 

system device 21 includes an interface 35 comprising an I/O closure and drawings of which are specifically incorporated 

board 47 and a processor board 46 which allow the devices herein by reference. The network communication protocol 
to be direcdy connected to the network 28. The I/O board 47 15 described by U.S. Pat No. 5,245,604 is referred to herein as 

is specifically constructed for use with the bus network the Medialink protocol. The advantage of the MediaLink 

configuration and a particular type of transmission medium, protocol is that it provides an upper limit on the amount of 

whereas the processor board 46 can be used with different time it takes to communicate over the bus network 28, This 

conomu nication configurations and transmission media. is important in real-time environments such as a musical 

The processor board 46 of interface 35 controls the performance stage, where unpredictable delay would result 
conununication of the devices 21 over the bus network 28. unacceptable distortion. As aU network conununication 

Tlie processor board 46 includes a processor 41, an elec- protocols must, the MediaLink protocol includes a network 

tronicaUy erasable and programmable read-only memory resource sharing and management algorithm such that only 
(EEPROM) 58, and a random access memory (RAM) 59. device communicates over the bus network 28 at any 

One of ordinary skiU in the art will recognize that interface given time and such that each device has sufEaent 

35 includes many more components than those shown in access to the bus network 28. While the MediaUnk protocol 
FIG. 2. Such other con^nents are not described because bus network are presently preferred, it is to be 

they are conventional, and an understanding of them is not understood that other network protocols and networks other 

beUeved to be necessary to an understanding of the present than the type shown in HGS. 1 and 2 may be used in actual 

invention. embodiments of the invention, if desired. 

When a non-computer system device 21 sends data, a Those of ordinary skill in the art wiU also recognize that 

conmmnd, or program code (collectively referred to herein ^ non.«)mputer system device 21 may be a)nnected to 

asdata),theproceTsarboard46of interface35housedinthe P^^«°f ^0 "i a POHit-to-pomt configuration by 

device consfructs a packet of daU representing the relevant „ ? ^^^le so that a bndge 45 is unnecessaiy. For 

information. The processor board 46 determines the time at commumc^ting with the personal computer 20, the device 
whichthebusnetwork28isavailableforsendingthepacket ^! ^^^^^ u'^'i'^ ^'"^^l^' t 

The processor board 46 sends the packet to the I/O board 47 .^^ board 47, However, the I/O board 47 would be 

at the appropriate time, and upon receipt of the packet, the ^pecificaUy constructed for use with the point-to-point con- 
VO board transmits the packet via the bus network 28 to ^ figuration and a particular type of transmission medium, 

personal computer 20. When a non-computer system device Network and access management would obviously be 

21 receives data from a data source, such as the personal unnecessary smce the personal computer and the device arc 

computer 20, the I/O board 47 receives the packet over the interconnected m a pomt-to-point configuration. In a pomt- 

busnetwork28,andsendsthepackettotheprocessorboaid ^^'P^*"^ configuration the device is connects! to the per- 

46. Upon receipt of the packet, the processor board 46 of ^^^^ ^^"fjjf^ ^0 by a RS232 cable, m addiUon, one of 

interface 35 processes the packet and performs any appro- ^^^inary skdl m the art would appreaate that the coupbng 
priate function, possibly including sending a response ^^"^^ also include a radio frequency coupUng 

packet back to the personal computer 20. «^ ^^her couphng media. 

Typically, non-computer system devices come equipped Relevant Device Components 

with a variety of internal and external feature controls 29a 50 a non-computer system device 21 connected to the per- 

and feature displays 29b that are used to control and monitor sonal computer 20 via the network 28 (FIG. 1) is shown in 

the operation of such devices, including but not limited to laore detail in FIG. 3. In the illustrated embodiment of the 

volume controls, channel selectors, power switdies, input present invention, the chosen non-con^uter system device 

and output meters, etc. (in FIG. 1, internal controls and 2I is the two-channel an^)lifier 22, which has a control and 
displays are represented by phantom lines, while external 55 display panel 48 that contains a number of feature controls 

controls and displays are represented by solid lines). The 29a, including a first fader 49, a second fader 50, a first 

processor boards 46 in the non-computer system devices 21 power switch 51, a second power switch 52; and feature 

are further connected to these controls and displays to either displays 29b, including a first input meter 53, a first output 

control the devices directly or to control the devices in meter 54, a second input meter 55, and a second output 
conjunction with other processors or controllers within the ^ meter 56. One of the faders, power switches and input and 

devices based upon packets received over the bus network output meters is associated with each of the channels. As 

28. -vvill be apparent to one of ordinary skill in the art from the 

The bus network 28 shown in FIGS. 1 and 2 can be present description of an exemplary preferred embodiment 

formed of various coupling media such as glass or plastic of the invention, the feature controls and displays shown in 
fiber optic cables, coaxial cables, twisted wire pair cables, 65 FIG. 3 should be construed as exemplary and not limiting, 

ribbon cables, etc. In the professional audio industry it is Other types of amplifiers could include various controls and 

generally preferable to use fiber optic cables, as fiber optic displays (such as mute controls, fuse temperature gauges, 
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etc.) other than or in addition to those shown in FIG. 3. to control the amplifier 22. For ease of understanding, the 

Moreover, devices other than amplifiers include other types same reference numbers plus the letter "a" are used in FIG. 

of controls and displays, depending upon the nature of each 4 to refer to the visual device controls (VDCs) as were used 

device. to refer to the feature controls and displays shown in FIG. 3. 

The amplifier 22 shown in FIG. 3 is equipped with the 5 For purposes of explaining the operation of the graphical 

hardware described above necessary to connect the anrolifier ^^ontxol system of the invention, several of the key compo- 

22 to the personal computer 20 via the network 28 so that pe^onal comput^ 20 are iUustrated in HG. 5. 

data packets may be sent between the amplifier 22 and the ^ ^parent to those of ordinary skill in the art tiiat 

personal computer 20. More specifically, the amplifier 22 is ff'^^^ comput^O includes many more components than 

equipped with a processor board 46 and an 1/0 board 47. lo ^^^^^^7° ^1^' ^' Such other components are not 

With respect to the processor board 46, the processor 41 desoibed because they are conventional, and an understand- 

preferably includes read-only memory (ROM) that stores '^^^ ^^^^'^^ ^ understanding of the 

program code for controlling the communication of the ^^^^ i^T 

device with the personal computer 20 and with other FIG. 5 shows a CPU 60 coupled by a bus 62 to a read-only 

devices. The EEPROM 58 is used by the processor 41 for 15 memory (ROM) 67 and a random access memory (RAM) 

controlling the functionaUty of the arapUfier 22 and stores a responds to program instructions stored in the 

portion of the visual network operating system. The RAM ^'^ temporarily in the RAM 68. The computer 20 

59 is used by the processor 41 during operation to tempo- includes a permanent storage device 66, such as a hard 

rarily store some j^ogram code and data, including a class ^ ^ ^^PPy ^^k drive, that is connected to the 

databasecontaininginstancesofeachclassenq)loyedbythe 20 CTU by the bus 62. The CPU 60 is controlled by a portion 

portion of &e visual network operating system stored in the visual network operating system 78 fiinctionaUy 

EEPROM. shown as coupled to the bus 62, but acmally stcared in a 

xjonh rtf ti,A f^ot„r*. /.««twxic j:c«i«„ iou sultablc one of the memories. A class database 65 containing 

Each 01 the feature controls 29a and feature displays 29^ «f «„«u «i « u,. *u • t *„ ? 

<r*u«r/:^ ^ * £ ^ ^ instances of each class enmloyed by the visual network 

of the amplifier 22 governs a certam feature or aspect « ^~Tj« r» ah* t ^ * 

. » J .^u ^. J 1. . J 25 operatmg system 78 IS stared in the RAM 68. In addition to 

associated with the amplifier and can be represented by a ^ „„«,ufL If a -u ^ j *u n • 

nmnericalvaluc.For^le,thefirstfader49controlsL L j^Z^J^J^^.J^. « 

volumeproducedbyo^th;channdsoftheanipMer22. tT^u'^y^^^f^ ^^^Ih 

nie value represented by the setting of the fimfader is a ^1,^}^,^. ™ Pjf u^^l 

, ^ u 1 u • .* u *u ^-i services, mdudmg but not limited to network pollmg, task 

nmnber of decibels being oi^ut by the ai^Mer 22. The scheduling, loadi^ and saving data and obje^, nSssive 

first power switeh 51 is another sample. The fl«t power ^ ^^jert and data m^pulation, object creation and disposal, 

switch controls the apphcation of power to the first channel and database travered 

of amplifier 22. When power is being supplied, the state of . ... .. ™ - . ^ , ^ ^. 

the power switch can berepresented by the value "1". When ^ ^l^'*"'^'^ Y^^' «^f» ei^^ent of (he 

power is not being supplied, the state of the power switch Pf«ent invention, the graphical control system produces the 

can be represented by the value "0". Amplifier Panel window 38 on the screen 34 of the personal 

„ .. r . J. , »„, ^ ^ comiutcr 20. FIG. 6 shows the Amplifier Panel window in 

The reading of each feature isplay 296, such as first and ^u^h greater detail. The Amplifier Panel window 38 is a 

second input meters S3 and 55, can be represented by a predefined graphical control display of the control panel 48 

numenral value as well, ^splays notmally represent con- ^ 3 Consequently, the 

stanflyfluctuattog values. For example, fiist input meter 53 ^ Amplifier Panel window 38 contains a VDC 40 for each 

momtois the level of power bang input into fte first feature control 29« or feature display 29i» of the amplifier 

channe , designated Chamiel 1, of ttie amplifier. Since the 22. Since each VDC 40 graphicaUy represents a control or 

power level constantly fluctuates, the numen<al value rep- j^y of the amplifier, each VDC 40 visually represents 

resentmg the power level and hence, the second input meter ^^^^ ^^^^ actually represented and govaned by 

readmg. constanUy fluctuate as well In a simdar manner, ^ -^^ control 29a or display 29fe counterpart That is, the VDCs 

each conttol and display that governs an aspect of any device 40 ^.^y either exactly repUcate external and internal feature 

controUable by a graphical control systan fonned in accor- controls 29fl and displays 29fc on saeen 34 that a user would 

dance wltii the present invention can be represented by a fi^^ amplifier 22, or the VDCs may functionally 

numencal value. represent such controls and displays. For exair()le. a rotary 

Relevant Computer Components *° toobon theampmer 22my befunctionaUyr^^^ 

ir- a VDC m the form of a slide display; or a VDC m the form 

The personal computer 20 included in HGS. 1 and 2 is of a linear scale or number display may be used to fiinc- 

shown in more detail in FIG. 4. The personal computer 20 tionally represent a dial display. It will be appreciated by 

includes a display or monitor 30, a keyboard 31, a mouse 32« those skilled in the art that for each device 21 on the network 

and a main unit 33. The monitor 30 includes a screen 34 on 55 28, the graphical control system of the present invention 

which various elements of a graphical control system produces a predefined gr^hical control display that repre- 

formed in accordance with this invention are displayed. The sents the control panel of the device, wherein the gr^hical 

displayed elements include windows 36 and 38, and graph- control display contains a VDC 40 for each control 29a and 

ics cursor 37. One of the illustrated windows 36 is named display 29^ of the device. 

*^etwork Inventcny" and the other illustrated window 38 is 60 In addition to gr^hically representing internal and exter- 

named "Amplifier Panel." The Network Inventory window nal feature controls 29a and displays 19h, each VDC 40 

36 contains three icons 39, each of which represents one of visually represents and controls the value actually repre- 

the non-computer devices 21 connected to the bus network sented and governed by its control or display counteipart 

28. The AmplifiCT Panel window 38 represents the control Using the previous examples, the VDC 49<i that graphically 

panel 48 of the amplifier 22 and includes a plurality of visual 65 represents the first fader 49 of the aiiq)lifier 22, controb the 

device controls (VDCs) 40, each of which graphically volume the amplifier by producing a value represented by 

rejH-esent a feature control 29fl or feature display 19b used the setting of the VDC 49o that is the number of decibels 
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being ou^ut by the amplifier. The VDC 51a that graphically iavention to the amplifier 22, where the graphical control 

represents the first power switch 51 of die amplifier 22 system fuither causes the amplifier interface 35 to adjust the 

controls a binary signal that represents the value "1" when Channel 1 volume controlled by first fader 49 so that it 

power is being supplied, and the value "0" when power is coiresponds to the diange in value. 

notbeingsuppUed.The VDCS3athatgraphically represents j ^ ^ ^^Uaiy, the first fader 49 also may be effectuated 

the first mput meter 53 of the amphfier represents and electrically or by control of another personal 

monitors the vdue associated with the power level bemg ^^^^ ^ ^ ^ ^ 2^ ^ ^ 

mput to tne aevice at any given instant u. ome. q^^^, ^ ^^j^^ ^j^^ 

amplifier 22 is inaeased by 

Smce VDCs 40 represent the controls 29« and displays manually operating the first fader 49, a change in the value 

29i of a device 21, it will be understood that the ^aphica^ lo represented by the first fader results. TTie graphical control 

control system of the present mvention eliminates the need ^ communicates the change in value to the personal 

forexteraal,inanuallyoperablecontrolsanddisplays.Inone computer 20 so that the visual device control element or 

actual embodiment of the present invenbon the devices 21 301 of the first fader VDC 49a is regenerated in a 

on the network 28 are fiiUy controUed by the personal ^^^^ coiresponds to the change in value, 

computer 20 and do not include any external, manually 15 „ „_A , • ^ . 

operable feature controls and feature displays whatsoever. S^^^ f VDCs 40 shown in HG. 6 represent feature 

inTe elimination of external feature controls and feature «f constantly bemg updated. For example, the 

displays reduces the cost and difficulty of manufacturing «£f' 7^. T T 

non-computer system devices. While the invention can be ^^^^^ ^he amplifier 22 at any Pven mstant. The value 

implemented in a way designed to eliminate the need for ^ rejffesentmg pow« Iwel that is displayed by Jc first mpu 

n^-computer system devicS to have external controls and ^3 « constancy fluctuatmg. Hence the pphi.^ 

displays, it is to be understood that in some embodiments of '^"f ^'^"^ constantly communicates ttus change in 

the invention it may be desirable to include external controls »° ^'^'j^ ?^^J^t 

and disolavs services provided by the VNOS 78 constantly poll the bus 

A u • ^ .1. irrN/- Aa en j et network 78 for such changes in value. As a result. When the 

AS shown in HG. (i, otha- VDCs 49a, 50a and 53a 25 , , ^DC 53^ is regenerated, its visual device 

-"P'? , « f I 49, the second fader SO control element or display 'Value" changes in accordance 

and the first input meter S3 of fte amphfier 22 *ow ^.^ fluctuation of the first input meter 53. As a 

3. respeaively. In addition, the second mput meter SS is ^ ^ ^ >; 53 

graphicaUy represented by anotha VDC SSa,wlul^^ amplifier 22 from the saeen 34. 

and second output meters 54 and 56 are graphically repre- 30 , ^ , . . , 

sented by stiU other VDCs 54a and 56^, respectively. The element of the graphical control system that controls 

Finally, stUl other VDCs 51a and S2a represent the first and personal computer system 20 and the device interface 35 

second power switches 51 and 52, respectively. such that the VDCs 40 repUcate and control the feature 

TTie VDCs 40 differ from the icons 39 shown in FIG. 4 in ^^^^f^' and displays 29b is ^0 visual network operat- 

that each icon is a static graphical representation of an entire 35 ^^^^^ ^^^^ descnbed next, 

device itself. Merely selecting an icon using the mouse does xhe Visual Network Operating System 
not control the feature controls 29a and displays 29b of die 

device. In contrast, a VDC 40 is a dynamic graphical replica f^G. 7 is a flow chart illustrating the control and moni- 

or representation of the feature controls 29a and feature Coring functions performed by the visual operating system 

displays 29^? of a device 21, having the same properties and 40 (VNOS) 78 of tiie present invention and tiie order in which 

characteristics of its control or display counterpart, these functions are performed. As noted above, VNOS 78 is 

Therefore, in order to initiate execution of one of the a distributed operating system that is partiaUy stored in the 

controls or displays of tiie amplifier 22 shown in FIG. 3 personal conq)uter 20 and partially stored in the interfaces 

using tiie graphical control system of tiie present invention, ^® devices 21. The major portion is stored in the 

tiie user manipulates cursor 37 usmg the mouse 32, such that 45 personal conq)Uter. Blocks 80, 81 and 82 represent tiie 

tiie cursor is positioned over tiie desired control VDC 40 in functions of VNOS tiiat control tiie operation of tiie personal 

tiie An^jlifier Panel window 36. One of ordinary skill in flie computer 20 and blocks 83, 84 and 85 represent tfie fianc- 

art would appreciate tfiat any conventional graphical control tions of VNOS tiiat control tiie interface 35 of a device 21. 

device, such as a track ball, joystick, touch saeen, etc. may Beginning at block 80, VNOS generates a graphical 

be used instead of the mouse. For example, the VDC 49c 50 control display upon the saeen 34 of the pasonal computa 

represents first fada 49 and is used to control tiic volume of 20 tiiat contains a number of VDCs 40. As previously 

Channel 1 of tiic amplifier 22. Hence, the value represented described, each VDC graphically represents a conesponding 

by the setting of this VDC 49a is the volume being output feature control 29a or feature display 29b of one of tiie 

by the amplifier, which may be displayed in decibels. To devices 21 to be controlled (FIG. 1). In addition to display 

inaease tiie volume of Channel 1 of the amplifier using tiie 55 graphics, each VDC represents a particular value associated 

first fader VDC 49a, the user manipulates tiie cursor 37 with a corresponding control 29a or display 29b. Whenever 

using the mouse 32, such tiiat the cursor is positioned ova the usa manipulates a VDC using tiie mouse 32, or some 

a visual control element or device, "knob" 301 that forms otiier control device, in the appropriate manna, a change in 

part of the first fada VDC 49a. The usa then "grabs" the the associated value results. Hence, in block 81, VNOS 

knob 301 using a predefined function such as depressing a 60 interprets the value, which is then stored in RAM 68 of the 

button of the mouse and moves the knob upwardly by pasonal computer 20, In some embodiments of the 

correspondingly moving the mouse. Hie user tiien releases invention, VNOS may furtha manipulate and change tiie 

the knob 301 by releasing tiie button on tfie mouse. As a value before storing it At block 82, VNOS communicates 

result, the first fada VDC 49a is graphically manipulated the change in the value associated with tiie feature control or 

and reset, resulting in a change to the value represented by 65 display to the related device 21 via the bus network 28. 

tiie first fada VDC 49a. This change in value is tiien Proceeding to block 83, at flie device interface 35, VNOS 

communicatcdbythegraphical control system of the present receives tfie change in value associated with the feature 
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control 19a or display 29b, At block 84, VNOS interprets as new devices, appear or disq)pear on the network, by 
and stores the change in value in the RAM 59 located in the merely changing lie data, since an object is interoperable 
interface 35. Again, in some embodiments VNOS may and need only be concerned about how it represents the data 

further manipulate and change the value before storing it for which it is responsible. 

Fmally, at block 85, VNOS causes the interface 35 to adjust 5 yet another fundamental aspect of object-oriented pro- 
the corresponding control or display in accordance with the gramming is that objects are composable, i.e., the methods 
change m value stored m the interface RAM. surrounding the data may be predefined and subsequently 
While VNOS 78 of the graj^cal control system of the modified. Generic me&ods 96 and 98 around the outer part 
present invention is designed, in part, for use in tiie forward of the doughnut are generic methods present in all objects of 
direction beginning at block 80 and preceding to block 85, a dass. Generic methods 96 are generally those used to 
in some embodiments of the invention it may be desirable translate the data 92 into a linear, textual rqjresentation so 
for the device 21 to be manually operated by a control 29fl that the data can be directed to and firom a text file in storage 
located on the device or by another computer. In addition, a 66 of the personal computer 20 by the platform operating 
control 29fl or display 19b may be automatically and elec- services of VNOS 78. Genaic methods 96 are en[q)loyed 
tricaUy adjusted by a command generated internally, as is the when the user requests a full stale save or restoration of all 
case with meters and temperature gauges tfiat monitor objects upon shut-down or power-up of the personal com- 
constantly fluctuating values. In such cases, tiie order in puter. Generic methods 96 are also referred to as "interpret 
which the VNOS functions are performed in FIG. 7 is and describe" methods, Genaic methods 98 provide for 
reversed so that communication begins at block 85 and communication between objects including me&ods for gen- 
proceeds to block 80. In this case, a change in value resulting 20 crating pointers to otfier objects and methods for sending 
firom an adjustment of a feature control or display at the messages to other objects. 

device 21 is sent firom the device to the other devices and to as opposed to generic methods 96 and 98, class-specific 
the personal computer. As a result, the VDCrepresentmg the methods 94 are unique for a particular dass. The class- 
control or display on the screen 34 of the personal computer specific methods 94 usuaUy provide the logic that in^le- 
is regenerated in accordance with the change in value. 25 ments spedal behaviors of the object 90 that are unique to 

^ ^, . ^ , the particular class. 

The Object-Onented Progranumng Paradigm of . .t. t.. . ■ . ^ 

VNOS shows the object-oriented programming para- 
digm from a class hierarchy perspective as employed by the 

In order to accomplish the functions generally depicted in portion of VNOS 78 stored in the personal computer. In an 

FIG. 7 and described above, VNOS 78 uses an object- object-oriented prograimning paradigm, objects are catego- 

oriented programming paradigm to represent non-computer rized into classes, where a dass defines a category of 

system devices 21. One fundamental aspect of object- methods and data within its objects. Methods as applied to 

oriented programming paradigms is that objects can be data define the behavior of an object An instance is a 

organized into classes in a hierarchical fashion. Classes are 3^ specific object with the behaviors defined by its dass. The 

abstract generic descriptions of objects and their behaviors. object-oriented programming paradigm en^)loyed by the 

A class defines a certain category or grouping of methods portion of VNOS 78 stored in the personal computer 20 

and data within an object Methods provide the 'intelli- primarily eniq)loys five different objects — a window object 

gence" of a dass and compdse procedures or codes that 100, a visual reference object 102, a value control element 

operate upon fee data. Methods as applied to data define the ^ (VCE) object 104, a device object 106 and a packet object 

behavior of an object This concentration of intelligence in 108. Each object is shown as a class beneath the dass 

the methods of object dasses is essential in object-oriented "object 90. Briefly, window objects 100 contain the data 

systems. It permits large-scale maintenance efforts, since the and methods necessary for displaying a window on a com- 

methods or intelligence of objects is inherited from their puter screen 34; visual reference objects 102 contain the 

dass. So, effecting a change once in the methods of a dass methods and data necessary for generating an icon 39 or 

will automatically effect changes in the methods of all the VDC 40 of a window object; value control dement (VCE) 

objects of that class and its subdasses. objects 104 contain the value represented by a VDC and the 

As shown io FIG. 8, an object 90 can be modded by a methods for manipulating that value; device objects 106 

doughnut with data 92 being located in the center of the contain the methods and data for communicating with a 

doughnut The data 92 rejH:esents various attributes of the 50 Particular type of non-co^^)uter system device 21 and for 

object 90 induding but not limited to addresses in memory managing a graphical control display of that device; and 

for the instances of the object, a database containing more padcet objects 108 contain the methods and data for com- 

objects, and pointers to other objects. Around the outer part municating data between a device 21 and the computer 20 

of the doughnut are two regions denoted generic methods 96 network 28. 

and 98, and another region denoted class-specific methods 55 As will be readily ^jparent to one of ordinary skiH in the 

94, which are employed by the graphical control system of object-oriented progranuning art, the window, visual 

the present invention to interact with the data 92. reference, VCE, device and packet objects (\;^1iich are shown 

Another fundamental aspect of object-oriented program- *s dasses in FIG. 9A) may be subdivided into further 

ming is that objects are interoperable. In this regard, the subclasses. For example, device object 106 may be divided 

generic methods 96 and 98, and dass-spedfic methods 94 60 subclasses of amplifiers, equalizers, CD players, etc 

that interact with the data 92 totally surround the data and, Each of these subdasses may then be subdivided again. For 

in a sense, encapsulate the data. Only the methods in the example, the subclass of amplifiers may be divided into 

outer part of the doughnut are allowed to know anything subclasses of anq)lifiers wherein each subclass comprises 

about the data. The methods isolate the encapsulated data aii^)lifiers jffoduced by a particular manufacturer, 

from other parts of the system making the object interoper- 65 FIG. 9A also illustrates the rdationship between object 

able with other objects regardless of the data contained by classes and instances (Le., specific objects) in the object- 

thosc objects. The user is capable of modifying the system oriented programming paradigm. As previously described. 
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each object is shown as a class beneath the class "object." window objects 100. The class-specific methods 524 of a 

Rirther, each class can generate one or more instances. visual reference object 102 generate the graphical general 

An:q}Mer Panel window 38 in FIG. 6 is an example of a appearance of an icon 39 or a VDC 40. The class-specific 

window instance 110 of window object 100, wherein win- methods 524 of a visual reference object 102 may also be 

dow object 100 is shown as a class beneath the class 5 used to change a style or functional representation of a VDC 

"object," 40. Using a previous exanq)le, class-speciiic methods 524 

A VDC 40 contained in a window instance 110, such as provided by a user may cause a VDC originally in the form 

the first fader VDC 49a in Amplifier Panel window 38 of a dial display to be regenerated into a linear scale or 

shown in FIG. 6 is represented by a visual reference instance number display. Further, class-specific methods 524 pro- 

112 of visual reference object 102. The visual reference jq vided by the user can change the type, color, shape, size, 

object 102 is also shown as a class beneath the class orientation or operation thresholds of a VDC 40. change a 

"object." Each VDC in a window instance 110 is rqiresented style or functional r^resentation of a VDC 40. Using a 

by its own visual reference instance. Visual reference previous example, class-specific methods 524 provided by a 

instance 112 may have associated with it a value control user may cause a VDC originally in the form of a dial 

element (VCE) instance 114. If so, a VCE instance 114 is display to be regenerated into a linear scale or number 

generated when a VDC 40 is displayed in the window display, Further, class-specific methods 524 provided by the 

instance 110. The VCE instance 114 contains the particular user can change the type, color, shape, size, orientation or 

value or change in value represented by the VDC. For operation thresholds of a VDC 40. A user simply loads or 

example, if the first fader VDC 49 of the anq)lifier 22 is set ^^j^ops in" code comprising the class-specific methods pro- 

at 6 decibels, the VCE instance 114 will contain the value 6. ^ided by the manufacturer into a visual reference object 102 

KthefirstfaderyDC49aisresetto8decibds,thenth^ 20 ^^^^ custom VDC. Further details con- 

mstance 114 will be changed to the value 8. automatic regeneration of a VDC's graphical 

Each yC^ instance 114 is associated with a device dimensions is provided below, 
instance 116. An example of a device mstance 116 is the „. ^ a s^'y e • t ^« u- ^ 
amplifier22. Adevi^stancewillexistforeachdevice21 ^mally, &e data 522 of a ^asual reference object 102 
on&e network. Furthermore, each device instance 116 may 25 ^^^^^^ ^ of pomtcrs to other wmdow objects, VCE 
be associated with a packet instance 118. Each packet ol>jects. device objects, and other visual reference objects 
instance 118 represents either an incoming or outgoing having the same ongin. The genenc methods 526 of a visual 
packet that is communicated between a device 21 and the reference object 102 provide for the translation of the data 
personal computer 20 via the bus network 28, 522 of the visual reference object, while the generic methods 
A more detaUed description of each of the five objects 30 ^28 provide communication between the visual reference 
eII^)loyed by VNOS 78 foUows. As illustrated in FIG. 8 and object 102 and the remaining objects, 
described above, object 90 contains data 92, generic meth- The VCE object 104 serves to interpret, store and perhaps 
ods 96 and 98, and class-specific methods 94. Each of the further manipulate the value represented by a VDC 40. The 
five objects employed by VNOS 78 and shown as a class data 542 of a VCE object 104 comprises the value rqjre- 
beneath the class "object" 90 inherits data 92, generic 35 sented by the VDC. Consequently, when a VDC is manipu- 
methods 96 and 98, and class-specific methods 94, while lated by the user to cause a change in the displayed value, 
adding new data and methods. FIG. 9B illustrates the new the VCE object data 542 will change in a corresponding 
and inherited methods and data contained by each of the five manner. The value contained in the VCE object data 542 
objects depicted in FIG. 9A. Since the methods and data may undergo further manipulation as provided by the class- 
within each of the five objects con^)rises methods and data 40 specific methods 544 of the VCE objert 104. For example, 
inherited fi-om class "object" 90 plus new methods and data, the class-specific methods 544 may further change the value 
the reference numbers used in FIG. 9B to identiiy the by executing a scaling function on the value or converting a 
methods and data within each of the five objects mirror those numerical value to a textual value. As with visual reference 
used to identify the methods and data of object 90. objects 102, a user may load code comprising the class- 
Now referring to FIG. 9B, each window object 100 45 specific methods into a VCE object 104 using the platform 
provides the data and methods necessary for displaying a operating services provided by the portion of VNOS 78 
window on screen 34. The data 502 contained by a window stored in the computer 20. 

object 100 comprises a database of visual reference objects As is the case with every other object the VCE object data 

102 and list of pointers to related visual reference objects, 542 includes a list of pointers to related window, visual 

VCE objects, device objects, and other window objects. As 50 reference, VCE, device and packet objects and gen^ic 

noted above, the generic methods 506 and 508 contained in methods 546 providing for communication between these 

a window object 100 will comprise inherited generic meth- objects. However, unlike the window object 100 and the 

ods 96 and 98 fi-om the class "object" 90 and new methods. visual reforence object 102, the VCE object itself does not 

Consequendy, the generic methods 506 translate window appear on tfie computer screen 34. Hence, class-specific 

object data 502 into a linear, textual representation that is 55 methods 544, which would normally control a VCE object's 

directed to a text file located in the storage 66 of the personal appearance are not present. 

computer 20. Meanwhile, the class-specific methods 504 In one of the preferred embodiments of VNOS 78, the 

contained in a window object 100 provide the graphical data542andclass-specificmethods544of VCE objects 104 

appearance of a window as defined by that computer's can be used to define ''master" and "slave" VCE objects, 

particular windowing environment, such as the Apple Mac eo wherein a master VCE object can be used to control a slave 

OS or Microsoft Windows, In addition, the class-spcdfic VCE object. In this embodiment, VCE object data 542 

methods 504 provide for the organization of the icons 39 and comprises a list of pointers to slave and master VCE objects, 

VDCs 40 within the window object 100. The generic meth- while the class-specific methods provide logic for manipu- 

ods 508 of a window object provide communication lating slave and master VCE objects. Further details of this 

l)etween the remaining four classes of objects. 55 aspect of the invention are provided below. 

The purpose of a visual reference object 102 is to generate A device object 106 contains the methods and data for 

visible saeen entities such as icons 39 or VDCs 40 in the conununicating with a particular type of device 21 and for 
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managing a graphical control display, i.e., a graphical rep- established by the pointers li nkin g the instances. In addition, 
resentation of that device in a window. The data 562 of a those of ordinary skill in this art will appreciate that the flow 

device object 106 contains a database of related VCE objects of messages is bi-directional, meaning messages may flow 
104 and list of pointers to the other device objects in the between instances in either direction. An exception exists for 
same dass. Generic methods 566 of a device object 106 5 messages sent to and from packet instances since packet 
provides for data translation, while generic methods 568 of instances are either incoming from or outgoing to the bus 

a device object provide for communication between the network 28. 

device object and the four remaining objects. Qass-spedfic piG. 10 iUustrates one actual embodiment of the present 

methods 564 of a device object provide for special window, invention, in which the graphical control system notifies the 

packet, and VCE object handling and for managing the lO user that a device has appeared on the netwoik. Jn this 

graphical control display or graphical rqjresentation of a particular embodiment VNOS 78a generates window 

device 21 in a window, such as Amplifier Panel window 38 instance 120 on the screen 34 of the personal con4)uter 20. 

shown in FIG. 4. Poj. pmposes of illustration and continuity, the window 

A packet object 108 contains the methods and data for instance 120 shown in FIG. 10 is the Network Inventory 

genericaliy communicating between a device 21 and the 15 window 38 depicted in FIG. 4. 

computer 20 via the bus network 28. In addition, die data when a device 21, such as amplifier 22, the tuner 24 or the 

582 of a packet object 108 contains a list of pointas to gr^hic equalizer 26 first appears on the network 40, die 

related VCE objects 104 and device objects 106. The data device interface 35 sends out a special packet announcing 

582 of a packet object includes device infamation to be the device over the network 40. The platfonn services 

transmitted over the netwcHTk in a data packet Hence, packet 20 provided by the portion of VNOS 78 stored in the computer 

object data 582 contains the value(s) represented by one or 20 continually poll the network for incoming packets from 

mOTe VDCs and stored in one or more VCEs. Class-specific devices. Upon receipt of the special packet, the platform 

methods 584 of a packet object 108 provide for communi- operating services transforms the packet into an incoming 

cation between the personal computer 20 and devices 21 via packet instance 128, 138 or 148, creates a device instance 

the netwOTk28 over differentportsorin conjunction with the ^ i26, 136 or 146 representing the new device, and aeate a 

MediaUnk protocol. visual reference instance 122, 132 or 142. The packet 

By definition, an instance is a specific object with the instance 128, 138 or 148 sends a message to device instance 

behaviors defined by its class. An instance inherits all the 126, 136 or 146 notifying it of the device's presence. Once 

methods of its class, but has particular data associated with notified, the device instance 126, 136 or 146 sends a 

it that is unique. Consequently, each instance 110 through ^ message to a visual reference instance 122, 132 or 142. The 

118 inherits the generic and class-specific methods of its visual reference instance 122, 132 or 142 then provides 

class. For example, a window instance 110 inherits the generic m^ods 526 (FIG. 9B) for generating an icon 400, 

generic methods 506 and 508, and the class-specific raeth- 402 or 404 representing the device in the window instance 

ods 504 of the related window object 100. Thus, a window . 120. The appearance of the icon 400, 402 or 404 on the 

instance includes generic methods 516 and 518, and class- screen 34 notifies the user that device is connected to the bus 

{Specific mefliods 514, plus unique data 512. Likewise, the network 28. 

data and methods of the remaining instances include generic Assuming that a number of devices 21 are connected to 

methods, class-specific methods and data. The window, the network, ultimately, window instance 120 will contain a 

visual reference, VCE, device and packet instances are plurality of icons 400, 402 and 404, each representing a 

located m the class database 65 stored in the RAM 68 of the ^ device 21. Related VCE instances 112 are unnecessary 

personal computer 20. because icons do not represent feature controls 29a, and 

rm. i-. u ' 1 ^ , m hence, do not have a value associated with such a control. In 

TTie Graphical Control System ^ ^^^^^^ p^^.^.^^^ 

As described above, the preferred embodiment of the 45 cursor 37 over the desired icon 400, 402 or 404, and 

graphical control system of die present invention includes a performs a predefined function, such as double clicking a 

personal computer 20, an interface 35 for eadi non- mouse button. For exaiiq)le, if the user selects amplifier 22, 

conq)uter system device 21 having at least one feature represented by icon 400, a window instance 140 of the type 

control 29a or display 29b, a bus network 28 for connecting shown in FIG. 11 may appear on die screen 34. 

the computer 20 to the interface(s) 35, and a VNOS 78 based 50 FIG. 11 is used to illustrate how the graphical control 

on the object-oriented programming paradigm just system of the invention enables a user to control a device via 

described. Embodiments of diis graphical control system a graphical representation. As described above, VNOS 78 

can best be understood by describing the jaresently preferred generates a window instance 140 on the screen 34 based 

embodiment of VNOS 78 and the object-oriented program- upon performing a predetermined function when a cursor is 

ming paradigm in which it exists. Such a description fol- 55 positioned over an icon. The window instance 140 is sim- 

lows. plificd by showing only a part of the Amplifier Panel 

Returning briefly to FIG. 7, it is the window, visual window 36 depicted in FIGS. 4 and 6. Specifically, only the 

reference, VCE, device and packet instances that carry out Channel 1 input meter VDC 53a and the first and second 

the VNOS 78 functions depicted in blocks 80 through 85 and fader VDCs 49a and 50a are shown. As discussed above in 

described above. The flow of messages between these 60 connection with FIG, 6, the user can graphically manipulate 

instances within the object-oriented programming paradigm ^^V of the VDCs by using the mouse 32 to guide the cursor 

are more fiiUy described next. For purposes of clarity in 37 and perform some predefined function, such as clicking 

illustration, the pointers linldng each instance have been ^ mouse button, aU in a conventional manner, 

omitted so that only the flow of messages between instances When die user manipulates the first fader VDC 49a, die 

is shown in die accon^>anying figures. However, those of 65 user causes a variation in or changes the value represented 

ordinary skill in die object-oriented programming art will by the setting of die first fader VDC 49a. As a result, die 

recognize diat die flow of messages follows the patiis window instance 140 sends a message to a related visual 
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reference instance 162 notifying it of the change in value. they are regenerated in a way that shows the change. For 

The visual reference instance 162 responds in two ways. example, if the volume of Channel 1 of the amplifier 22 is 

First, the generic methods 536 of the visual reference inaeased by manually adjusting the first fader 49, VNOS 78 

instance 162 regenerate the first fader VDC 49a so that it causes the amplifier interface 35 to send a packet containing 

corresponds graphically to the change in value. To the user, 5 the change in value to the personal con^uter 20 via the bus 

this regeneration appears instantaneously. Second, the visual network 28. The platform operating services provided by the 

reference instance 162 sends a message to a VCE instance part of VNOS 78 located at the personal computer 20 

164 associated with first fader VDC 4,9a notifying it of the transforms the packet into an incoming packet instance 168. 

change in value. The VCE instance 164 stores the change in The incoming packet instance 168 sends a message to device 

value caused by the user manipulation and sends a message instance 166 of the amplifier that notifies the device instance 

to a device instance 166 that represents the amplifier 22. of the change in value made by the manual adjustment of the 

The class-specific methods 544 of the VCE instance 164 first fada: 49. The generic methods 578 of the device 

associated witii the first fader VDC 49a may further manipu- instance 166 then send a message to the VCE instance 164 

late and change the value before sending a message to the associated with the first fader VDC 49a. The change in value 

device instance 166. For example, the user may desire to associated with first fader 49 is then stored in the VCE 

increase the volume to 20 decibels. In order to accomplish instance 164. The VCE instance 164 then sends a message 

this, the user uses the mouse 32 to adjust the movable to the visual reference instance 162 notifying it of the change 

element of the first fader VDC 49a to a 20-dedbel level. If in value. The methods of visual reference instance 162 

the class-specific methods 544 were predefined to set the causes the first fader VDC 49 to be regenerated in a manner 

maximum allowable decibel level at 15 decibels, the adjust- that corresponds to the change in value effectuated by 

ment level (20 decibels) could not be achieved. In this manually adjusting the first fader 49. 

example, the class-specific methods 544 would change the if the second fader 50 of the amplifier 22 is used to change 

value to be stored in the VCE instance 164 firom 20 decibels the volume in Channel 2 of the amplifier, virtually the same 

to 15 decibels. The VCE instance 164 would then send a sequence of events occurs, with one exception. The device 

message to both the visual reference instance 162 and the 25 instance 166 representing the amplifier 22 sends a message 

device instance 166 notifying them of this change in value. to the VCE instance 174 associated with the second fader 

Consequently, visual reference instance 162 would regen- VDC 50a, Consequently, visual reference instance 172 

erate the first fader VDC 49a so that its movable element regenerates the second fader VDC 50a in a way that coire- 

would correspond to 15 decibels. sponds to the change in value effectuated by the manual 

Once ncAified of the change in value, the class-specific 30 adjustment of the second fader 50. 

methods 576 of the device instance 166 prepares an outgo- It must also be appreciated that as a display 29b of a 

ing packet instance 178 containing the new value data 592. device 21 fluctuates, the flow of messages depicted in FIG. 

The outgoing packet instance 178 is then transformed into a 11 is reversed and the VDCs 40 graphically representing 

conventional packet by the platform operating services of those displays on the screen 34 are regenerated accordingly. 

VNOS 78 and sent over the network 28 to notify the 35 For example, as first input meter 53 flucmates, VNOS 78 

amplifier 22 of the change in value. Upon receipt, the causes the interface 35 of the anq)lifier 22 to repeatedly send 

amplifier interface 35 correspondingly adjusts the volume packets to the personal computer 20 via the bus network 28. 

controlled by first fader 49. The role of VNOS 78 at the Each packet contains the change in value associated with the 

device interface in adjusting controls, such as the first fader first input meter 53 at a particular instant. The platform 

49, is discussed in more detail below. 40 operating services provided by the portion of VNOS 78 

When the user graphically manipulates the second fader stored in the con^>uter constantly poll the bus network 28 for 
VDC 50a, virtually the same flow of messages results except incoming packets. Thus, the platform operating services 
that the second fader VDC 50a is associated with its own transform received packets in rapid succession. For each 
visual reference instance 172 and VCE instance 174. The packet transformed into an incoming packet instance by the 
second fader VDC 50a sends a message containing the 45 VNOS platform operating services, virtually the same 
change in value to the second fader visual reference instance sequence of events as described above occurs except that the 
172, which in turn sends a message to the second fader VCE flow of messages between instances is relatively constant 
instance 174. The second fader VCE instance 174 sends a More specifically, for each incoming packet instance 168, 
message notifying the same device instance 166 of the the device instance 166 of the amplifier 22 sends a message 
change in value. Consequently, both the first and second 50 to a VCE instance 154 associated with the first input meter 
fader VDCs 49a and 50a are linked to the same device VDC 53a. The VCE instance 154 stores the change in value 
instance 166. From the foregoing description, it should be associated with the first input meter 53 and sends a message 
apparent to those familiar with object-oriented programming to a visual reference instance 152. Consequentiy, visual 
that any VDC representing a control 29a or display 29h of reference instance 152 regenerates the first input meter VDC 
the amplifier 22 would be linked through a series of visual 55 53a. However, the visual reference instance 152 is con- 
reference instances and VCE instances to the same device stantly receiving a message notifying it of a change in value 
instance 166 so that any change in value caused by user because the power level being input into the amplifier 22 is 
manipulation of a VDC graphically representing a control or constantly fluctuating. Therefore, the visual reference 
display of the amplifier 22 is funneled to the amplifier 22 via instance 152 is constantly regenerating the first input meter 
the bus network 28. Obviously, the same procedures apply 60 VDC 53a so that the first input meter VDC 53a graphically 
to any other non-computer system device attached to the bus depicts the changing power level being input into the 
network. amplifier 22. 

It should be undentood that when a control 29a of a FIG. 12 illustrates the flow of messages between object 

device 21 is changed (e.g., by manual operation or moni- instances when the graj^cal control system of the present 

tored electrical change), the flow of messages depicted in 65 invention enables the user to create a cloned VDC. For 

FIG. 11 is reversed and that when the VDCs 40 graphically purposes of continuity, the same An^jlifier Panel window 

representing those controls on screen 34 are regenerated instance 140 that appeared on screen 34 in FIG. 11 now 
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appears on saeen 34 in FIG. 12. However, the user has aiq)Mer interface 35 adjusts the volume controlled by the 

aeated anothar window instance 150 entitled **User View " second fader 50 to correspond to the change in value. Hence, 

A user makes a cloned VDC by dragging the desired VDC just as the behavior of second fader 50 can be controlled by 

from window instance 140 and dropping the dragged VDC the first fader VDC 50a, the behavior of second fader 50 can 

into the User View window instance 150 by manipulating a 5 be controlled by the second fada VDC clone SOaa. 

mouse 32 in a conventional manner. More specifically, a user in view of the preceding discussion, it will be apparent to 

moves the mouse until the cursor 37 is positioned over the those of ordinary skill in this art that any VDC 40 in any 

VDC, such as the second fader VDC 50^, to be dragged and window instance can be cloned in another window instance, 

dropped. Then, a mouse key is clicked (Le., depressed). TTie Thus, a user could create three cloned VDCs in the User 

mouse with the depressed key is then manipulated to move View window instance 150 shown in FIG. 12 in the manner 

the curscr to a desired location in the User View window described above, one for each of the non-con^)uter system 

instance 150, as shown by the dashed Une in FIG. 12. Then, devices (the amplifier 22, the tuner 24 and the equalizer 26) 

the mouse key is released. The end result is a second fader connected to the network. Or only some of the VDCs can be 

VDC clone 50afl located in the User View window instance cloned into the User View window. In this way a user can 

150. When this occurs, the platform operating services create his or her own unique gr^hical control display 

provided by VNOS 78 retrieve a visual reference instance con^msing VDCs associated with numerous devices. 

182 from the class database 65 and link the visual reference It must be appreciated that if first fader 49 or the second 

182 to a VCE instance 174 associated with the second fader fader 50 of the amplifier 22 are manually or electrically 

VDC clone 50^0, Since both the second fader VDC 50a and operated, or operated by another computer, the flow of 

the second fader VDC clone 50aa are linked to the same 20 messages illustrated in FIG. 12 is reversed. More 

VCE instance 174 as opposed to being linked to separate specifically, if first fader 49 of the aiiq)lifier 22 is manually 

VCE instances, the first fader VDC clone SOaa is an operated, VNOS 78 causes the amplifier interface 35 to send 

equivalent or done of the second fader VDC 50a. a packet to the computer 20 via the bus network 28. When 

Once the second fader VDC clone 50aa has been aeated the packet is received, the packet is transformed by the 

in the User View window instance 150, the user may use the 25 platform operating services provided by VNOS 78 into an 

second fader VDC clone 50fla to control the amplifier 22 incoming packet instance 168. The incoming packet 

instead of the second fader VDC 50fl in the same way as the instance 168 sends a message to the device instance 166 

second fader VDC 50a can be used to control the amplifier. notifying it that a change has occurred in the value assod- 

When the user manipulates the second fader VDC done ated with the first fader 49. Consequently, device instance 

50aa, the value visually represented by the second fader 30 166 sends a message to the first fader VCE instance 164. The 

VDC 50afl is changed. When this occurs, the User View first fader VCE instance 164 stores the change in value and 

window instance 150 sends a message to the visual reference sends a message to the first fader visual reference instance 

instance 182. The class-spedfic methods 534 of the related 162. The first fader visual reference instance 162 then 

visual reference instance 182 instantaneously respond and regenerates the first fader VDC 49a such that it visually 

regenerate the second fader VDC clone 50aa so ^at it 35 coiresponds to the change in value efiectuated by the manual 

graphically coiresponds to the change in value. The dass- operation of the first fader 49. 

specific methods 534 also support other gr^hical alterations if the setting of the second fader 50 is changed manually 

made to the second fader VDC clone, such as color changes, or electronically, the same sequence of events occurs except 

size, orientation, operation thresholds, and even the style of that the device instance 166 representing the amplifier 22 

the VDC. However, these graphical alterations do not affect 40 sends a message to the VCE instance 174 associated with 

the value visually represented by the second fader VDC, nor both the second fader VDC 50a and the second fader VDC 

do they affect the second fader VDC itself, as it qjpears to done 50aa. The VCE instance 174 sends a message to both 

the user. the second fader VDC visual reference instance 172 and to 

As the visual reference instance 182 regenerates the the second fader VDC done visual reference instance 182 

second fader VDC done 50aa, the visual reference instance 45 notifying them of the change in value. The second fader 

182 also sends a message to the VCE instance 174 assod- VDC visual reference instance 172 causes the second fader 

ated with both the second fader VDC 50a and the second VDC 50a to be regenerated in the Amplifier Panel window 

fader VDC done 50aa. The VCE instance 174 stores the instance 140, while the second fader VDC done visual 

change value. Since the VCE instance 174 is also associated reference instance 182 causes the second fader VDC clone 

with the second fader VDC 50a, the VCE instance 174 sends 50 SOoa to be regenerated VDC 304 in the User Mew window 

a message to visual reference instance 172 assodated with instance 150. To the user it appears that the second fader 

the second fader VDC, which regenerates the second fader VDC and the second fader VDC done are simultaneously 

VDC 50a in a manner that reflects the change in value. To being regenerated in a way that corresponds to the change in 

the user it appears that both the second fader VDC done value effectuated by the manual or electrical change made to 

50aa and the second fader VDC 50a are simultaneously 55 the second fader 50 of Ihe amplifier, 

regenerated on the computer screen 34. As illustrated in FIG. 13, both the length and width 

In addition to sending a message to the visual reference dimensions and the orientation of a VDC may be dianged by 

172, the VCE instance 174 sends a message to the device VNOS 78 independent of a change in valiie displayed by the 

instance 166 associated with the amplifier 22 notifying it of VDC. For purposes of continuity, the same User View 

the change in value effected by the user manipulation of the 60 window instance 150 shown in FIG. 12 is shown in FIG. 13. 

second fader VDC clone 50aa. The general methods 576 of Thus, FIG. 13 includes a User View window instance 150 

die device instance 166 then prepare an outgoing packet that indudes the second fader VDC done SOaa of the 

instance 178 containing data 592 con^)rising the change in amplifier 22. While for purposes of clarity in illustration, the 

value. The outgoing packet instance 178 is then transformed accompanying VCE, device and packet instances have been 

into a conventional packet by the platform operating ser- 65 omitted from FIG. 13, it wiU be appreciated that second 

vices provided by VNOS 78 and sent to the amplifier 22 over fader VDC clone 50aa remains assodated with those 

the network 28. When recdved by the amplifier 22, the instances firom FIG. 13, which are depicted in FIG. 12, 
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through the associated visual reference instance 182. As will 
be better understood from the following description, it is 
immaterial for purposes of this aspect of the invention 
whether the depicted VDC clone 50 is an original or a cloned 
VDC. 

As discussed above, the second fader VDC clone SOaa 
shown in FIG. 13 is a graphical representation of second 
fader 50 of the amplifier 22. The second fader VDC done 
50a appears as a rectangle having a height greater than its 
width that is operated vertically by moving a graphical knob 
305 upwardly toward a maximum (MAX) value or down- 
wardly toward a minimum (NUN) value. As described 
above, the knob is "moved" by appropriately manipulating 
a mouse or other cursor control device. Movement of the 
graphical knob changes the value represented by the second 
fader VDC clone 50ac and, in turn, causes the second fader 
VDC clone SOaa to be regenerated with the change in value 
depicted. 

In addition to including the second fader VDC done 
SOaa. FIG. 13 also indudes three other second fader VDC 
clones SO'aa, SO"aa^ and SQ"'aa having different height and 
width dimensions but otherwise having the same graphics as 
the second fader VDC clone SOaa. The height of the first 
other second fader VDC clone 50*aa is less and the width 
greater than the original second fader VDC done SOaa. The 
height of the second other second fader VDC clone 50"aa is 
less and the width greater than the first other second fader 
VDC clone 50 'aa. The height of the third other second fader 
VDC done SO"'aa is less and the width greato* than the 
second other second fader VDC clone SO"aa. Further, the 
orientation of the second fader clones is different The knob 
305 of the original and first other second fader VDC clones 
SOaa and SO 'aa are positioned for vertical movement, 
whereas the knob 305 of the second and third other second 
fader DC dones are positioned for horizontal movement. 
How VNOS changes a VDC is the manner shown in FIG. 13 
is described next 

Generic methods 566 of the visual reference instance 182 
associated with the second fader VDC done SOaa allow a 
user to use a mouse 32 or other cursor control device to 
simultaneously decrease the hdght of a VDC while increas- 
ing the width of the VDC. This is accomplished, for 
example, by using the mouse to place the cursor 37 over one 
vertical edge of the second fader VDC clone SOaa, depress- 
ing a button located on the mouse to "click" on the edge and 45 
dragging the edge outwardly by moving the mouse in the 
appropriate direction. As the width of the VDC increases, the 
height automatically deaeases. Continuing this action trans- 
forms tiie VDC from a VDC having a height greater than its 
width to a VDC having a width greater than its height When 
the width becomes greater than the height, the related 
window instance 150 sends a message to the visual reference 
instance 182 assodated with the second fader VDC clone. 
Upon receipt of this message, the class-specific methods 524 
of the visual reference instance 182 cause the second fader 
VDC clone to be automatically regenerated in a form 
designed for horizontal as opposed to vertical operation. In 
other words, the orientation of the second fader VDC done 
is rotated by 90** . Thus, while the second and third other 
second fader VDC clones 50 "aa and SO"'aa an still graphi- 
cally represent the second fader 50 of the an^lifier 22, they 
are operated by the graphical knob 305 of the VDC hori- 
zontally rather than vertically. The automatic reorientation 
of the second fader VDC done does not result in a change 
in value nor does it result in a change of the MAX and MEN 
values. Consequentiy, no messages are sent to the other 
VCE, device and packet instances (FIG. 12). As will be 
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appredated from the foregoing description, the second fader 
VDC clone may be returned to its original form having its 
original orientation and dimensions by reversing the fore- 
going procedure, if desired. It will also be appreciated that 
any other VDC 40 may be automatically resized and, if 
desired, reoriented in a similar manner. 

FIGS. 14, 15 and 16 illustrate how a master VDC is 
created and used to control a plurality of noncon^uter 
system devices 21. First, VNOS 78 is enabled to generate a 
window instance 160 entitied *Toolbox" which contains one 
or more "ten^)late" VDCs 306. A VDC is considered a 
"template" because it is not actually associated with any 
particular device 21. A template VDC graphically replicates 
a feature control or display of a hypothetical device. Because 
no device exists, only the template VDC 306 and an asso- 
ciated visual reference instance 192 are needed. A tenq)late 
VCE instance 194 contains a null value. A master VDC is 
created by a user first cloning the desired template VDC 306 
in a User View window instance 170, using a mouse or other 
cursor control device to manipulate the cursor 37 in the 
manner previously described. When this occurs, the related 
visual reference instance 192 and template VCE instance 
194 are replicated as well. Thus, new visual reference and 
VCE instances are created. For purposes of this description 
the cloned tenq)late VDC and the new visual refarence and 
VCE instances are hereinafter referred to as the master VDC 
308, the master visual reference instance 202, and the master 
VCE instance 204, respectively. Although not shown in FIG. 
14. Tool Box window instance 160 may contain a nmnber of 
"template" VDCs, each of which can be cloned in one or 
more User View window instances in the manner described 
above. It wiU also be ^predated that a template VDC may 
be "dropped" upon another VDC 40 using the mouse and 
that the VDC 40 will regenerate itself accordingly. 

Referring now to FIG. 15, two window instances are 
shown on screen 34 of the personal computer 20, the User 
View window instance 170 shown in FIG. 14 and an 
Amplifier Panel window instance 180. As described above, 
the User Mew window instance 170 contains the master 
VDC 308. FIG. 15 also includes tiie master reference 
instance 202 and the mater VCE instance 204. The Amplifier 
Panel window instance 180 contains a VDC 310 that graphi- 
cally represents a control 29a, such as a fader, of an 
an^lifier. The user, using a mouse or other cursor control 
device to manipulate the cursor 37 drags the amplifier 
control VDC 310 from the Amplifier Panel window instance 
180 into the User Mew window instance 170 in the manner 
previously described. The amplifier control VDC 310 is 
moved until it is positioned atop the master VDC where it is 
trapped by the user rdeasing a depressed key of the mouse 
or other cursor control device. When the amplifier control 
VDC 310 is dropped, an object-to-object interaction (as 
shown by the dotted line and phantom VDC) occurs. TTie 
objec^-to-object interaction establishes a master-slave rda- 
tionship between the amplifier control VDC 310 and the 
master VDC 308. 

The object-to-object interaction causes the User View 
window instance 170 to send a message to the master visual 
reference instance 202, which in turn sends a message to the 
master VCE instance 204. The class-specific methods 554 of 
tiie master VCE instance 204 establish a link to a VCE 
instance 214 associated with the amplifier control VDC 310 
by generating a pointer that points from tiie master VCE 
instance 204 to the amplifier control VCE instance 214, and 
a pointer from the amplifier control VCE instance 214 to the 
master VCE instance 204 (as noted earlier, pointers have 
been omitted in FIG. 15, for purposes of clarity in 
illustration). 
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After the foregoing link is established, the class-specific 
methods 554 of the master VCE instance 2(M have the 
ability to send control messages to the amplifier control VCE 
instance 214 and thereby control the behavior of anq3lifier 
control VCE instance 214. In this way the master VCE 
instance 204 becomes a master of the anq)lifier control VCE 
instance, which, in turn, becomes a "slave" VCE instance. 
Finally, the pointa to the amplifier control (slave) VCE 
instance 214 is added to a list of slave pointers included in 
the data 552 of the master VCE instance 204; and the pointer 
to the master VCE instance 204 is added to a list of master 
pointers included in the data of the amplifier control (slave) 
VCE instance 214. 

A further consequence of the master-slave relationship 
between the master VCE instance 204 and the- amplifier 
control (slave) VCE instance 214 is that master VDC 308 
controls the anq)lifier control, VDC 310 which, in turn, 
becomes a "slave'* VDC. In other words, since the master 
VDC 308 is associated with the master VCE instance 204, 
and the master VCE instance 204 governs the behavior of 
the amplifier control (slave) VCE instance 214, die master 
VDC 308 governs the amplifier control (slave) VDC 310. 

Once the master-slave relationship described above is 
established, the user may use the master VDC 308 located in 
the User View window instance 170 to control the feature 
(i.e., the amplifier control) depicted by the amplifier control 
(slave) VDC 310 in window instance 180. More specifically, 
when the user manipulates the master VDC 308, User View 
window instance 170 sends a message to the master visual 
reference instance 202. The master visual reference instance 
202 simultaneously regenerates the master VDC 308 to 
correspond to the change in value and sends a message to the 
master VCE instance 204. The master VCE instance 204 
stores the change in value and sends a control message to the 
anqjlifier control (slave) VCE instance 214, Prior to the 
message being sent, the class-specific methods 544 of the 
master VCE instance 204 may further manipulate the value. 

The amplifier control VCE instance 214 stores the change 
in value contained in the message received from the master 
VCE instance 204 and sends messages to the device instance 
216 and die visual reference instance 212 notifying both of 
the change in value. The device instance 216 sends a 
message to outgoing the packet instance 218. The outgoing 
packet instance 218 transforms this message into a conven- 
tional packet and sends the packet to the device being 
controlled (i.e., the amplifier) via the bus network 28. Upon 
receipt device interface 35 adjusts the control of the device 
24 to correspond to the change in value effectuated by the 
master VDC 310. 

As for the appearance of the amplifier control (slave) 
VDC 310, the amplifier control visual reference instance 
212 causes the amplifier control (slave) VDC 310 to be 
regenerated in a way that shows the change in value effec- 
tuated by the master VDC 308. Hence, the amplifier control 
(slave) VDC 310 graphically corresponds to the master VDC 
308. 

As shown in FIG. 16, the master VDC 308 can also be 
used to control a plurality of slave VDCs, as long as the 
slave VDCs are of the same type (e.g., the slave VDCs must 
graphically represent the same type of control or display). 
The master VDC 308 can simultaneously control a plurality 
of the same type of controls from the same device or a 
plurality of the same type of controls from different devices. 

HG. 16 includes all of the elements of FIG. 15 plus a 
second Aii^)lifier Panel window instance 190. The second 
Amplifier Panel window instance 190 contains an an^)lifier 
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control VDC 312 that graphically replicates the master VDC 
308 and the first amplifier control VDC 310. Although the 
an:q)lifier control VDC 312 is shown as a rq)lica of the 
master VDC 308 in FIG. 16 for ease of description, graphi- 

5 cal replication of VDCs is not required. Rather, only func- 
tional identity is required. Far example, a rotary control 
knob is functionally identical to a linear sliding knob, but 
gr^hically different. 
Again, using a mouse or other suitable cursor control 

10 device (e.g., a track ball) a user drags the second arrqilifier 
control VDC 312 from the second AmpUfia- Panel window 
instance 190 into the User View window instance 170 and 
drops it on the master VDC 308, creating another object- 
to-object interaction (as shown by fiie dotted line and 

15 phantom VDC in FIG. 16). This object-to-object interaction 
results in the creation of another master-slave relationship 
between the second an^lifier control VDC 312 and the 
master VDC 308. As a result, the VCE instance 224 asso- 
ciated with second amplifier control VDC 312 becomes a 

20 "slave" VCE instance 224 to the master VCE instance 204; 
and the second ampMer control VDC 312 becomes a 
"slave" to the master VDC 308. Consequently, the gr^hical 
manipulation of the master VDC 308 will result in an 
adjustment of the amplifier control of two devices (the first 

25 and second amplifiers). Manipulation of the noaster VDC 
308 will also cause the first and second amplifier control 
(slave) VDCs 310 and 310 to be regenerated in a way that 
shows the change made by manipulating the master VDC. It 
will be ^predated that numerous slave VDCs may be 

30 created in the same manner and manipulated by (he master 
VDC. 

It should be understood that when the related control of 
any device under the control of a master VDC is manually 
operated or operated electronically from another source, the 

35 flow of messages depicted in FIG. 16 is reversed. For 
exan^)le, if the amplifier control of the first anq)lifier is 
manually adjusted, VNOS 78 causes interface 35 of the first 
amplifier to send a packet containing the resultant change in 
value to the personal computer 20 via the bus network 28. 

40 Upon receipt, the packet is transformed into an incoming 
packet instance 218, causing messages to be sent to the 
device instance 216, die first amplifier control VCE instance 
214 and the first aiiq)lifier control visual reference instance 
212. The visual reference instance 212 regenerates the 

45 amplifier control VDC 310 so that it graphically shows the 
change in value effectuated by the manual operation of the 
first anqilifier control of the fjrst amplifier. In a prefeired 
embodiment, a message is also sent to the master VCE 
instance 204, which causes the master visual reference 

50 instance to regeno-ate the master VDC 308 so that it 
graphically shows the change in value effectuated by fee 
manual operation of the amplifier control 29a of the first 
amplifier. The master VCE instance 204 also sends a mes- 
sage to the second amplifier control VCE instance. Receipt 

55 of this message causes the second anq)lifier control VDC 
312 to be regenerated to show the change in value. Receipt 
of this message also causes the adjustment of the aiiq>lifier 
control of the second amplifier. 
Now that the VNOS 78 fiindions depicted in blocks 80, 

60 81 and 82 of FIG. 7 have been thoroughly described, the 
VNOS 78 functions carded out by the portion of VNOS 78 
stored at the non-computer system devices must be consid- 
ered. In order to cany out the functions depicted in blocks 
83, 84 and 85, VNOS 78 employs an object-oriented pro- 

65 gramming paradigm shown from a class hierarchy perspec- 
tive in HG. 17A. The object-oriented programming para- 
digm e^^)loyed by the portion of VNOS 78 stored in the 
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device interfaces 35 primarily employs two different objects. contains all the methods of its class, plus unique additional 

These objects are packet and device control clement (DCE) data. Consequently, both interface packet instances 117 and 

objects 107 and 109 and are shown as dass objects in FIG. instances 119 include all of the generic and class- 

17A. Briefly, interface packet obje^^^^^^^ specific methods of their class objects. For ease of 

to the packet object 108 employed by the personal computer 5 ^ . ^ ^ . r • * 1 * • • 

20, Thus, interface packet bbjects containttie methods and assoaation, the data of mterfacc packet mstance 117 is 

data for communicating data between devices 21 and the labeled data 612, and the generic and class-specific methods 

personal computer 20 via the bus network 28. DCEs objects 614 are labeled 616, 618 respectively. The data of DCE 

109 contain the value represented by a feature control 29a or instance 119 is labeled data 632. and the generic and dass 

display 29b of a device 21 and the methods for manipulating specific methods are labeled 636, 638 and 634 respectively, 

that value. g^^jj interface packet and DCE instance is stOTed in the class 

no. 17A also illustrates the relationsh^) between dasses database located in RAM 59 of the interface 35 of the related 

and instances in the object-oriented programming paradigm device 21 
used by the present invention. As previously described, each 

class object can generate one or more instances. Thus, an FIG. 18 illustrates the flow of messages between device 

interface packet object 107 can generate several interface instances when the graphical control system of the present 

packet instances 117. Likewise, a DCE object 109 can information effectuates a change in a device 21. When the 

generate several DCE instances 119. A packet sent or user manipulates a VDC 40 graphically rqiresenting a 

received by a device interface 35 is an example of an control 29<7 of a device 21, as discussed above, the personal 

interface packet instance 117. A DCE instance 119, on the computer 20 sends a packet containing the resultant change 

other hand, is generated when a feature control 29a or value to the appropriate device 21 via the bus network 28. 

display 29b on a device 21 as shown in FIG. 1 is effectuated ^^^^^^ ^ ^^^^^ packet is received by a 

dther mechanically, electrically or by manipulation of its ^^^^ interface 35, it is transformed into an incoming 

corresponding VDC 40. A DCE instance will exist for each ^^^^^ j^^j ^^^^ 217 by the platform operating 

featiKecontrol29a or display 29l.ofad^^^^ ^ ^^.^^^ ^^^^ by the portion of VNOS 78 stored in the 

interface packet and DCE msta^^^^^ are part of the class interface. The pack instance data 612 includes the change in 

database stored xn RAM 59 of the device mteif ace 35. ^^^^ ^^^^^^^^ manipulation of the VDC 40. Hie 

A more detmled descnpUon of each of the two objects ^^^^^^ ^^^^ ^17 sends a message to 

enmloyed by the portion of VNOS 78 located in the device , * j T^r^o • * ^ u • 1 • *i. 

inTxface 35 is n«t set forth. As iUustrated in HG. 8. ev«y 30 'f^'^i^^'^T'^ ^\^,J^ "^^^ " ^j?" Vh 

object 90 contains data 92; generic methods 96 and 98,^ stored m toe DCE mstance 219 TT,eproc«^^^ 

clis-specmc methods 94. HG. 17A iUustrates the methods "^^"^f^^ 1*°*° f n«ates an electronic 

and data contained by the packet and DCE objects and signal 229 whidi is sent to the control 29a of the device 21. 

instances depicted in FIQ. VIA. The signal 229 is used to adjust the control 29a to corre- 

Now referring to HG. 17A, interface packet objects 107 35 '° '*'>''8« ^^""^ effechiated by the VDC 40. 

contain the methods and data for communicating between a When a control 29a of a device 21 is effectuated locally 

device 21 and the computer 20 via the bus network 28. jjy nianual operation) or electronically by another 

Interface packet object date 602 include device information controller or internal command, the processor 41 of ttie 

to be transmitted over the network in a data packet Hence, interface 35 receives a signal 229 from the control 

interface packet olyect<Utaindude the vduer^^^^^^ 40 2»a. The platform operating services provided by the portion 

the con^ol or display. In addiUon, mterfacc pactet object ^f VNOS 78 located in the interface causes the processor 41 

date 602 Cf any) mcludes a hst of point«s to DCE objecte ^ ^^^^ ^19 and create 

109 and other interface packet objects 107 (if any). The ^ . . i * . * rru ^ ^ ^i^y 

dass-spedfic methods 604 of an intLface packet object 107 ^JlJ^^^g interface packet instance 227. The data 632 of 

providTfor communication between the pLonal computer 45 |he DCE mstance 219 comprises tiie cl^^^^^ 

20andthedevice21relatedtotheinterfacepacketobjectvia ing from effectuatmg the control 29a. The DCE mstance 219 

thenetwQrk28overdifferentportsorin conjunction withthe sends a message to the outgoing interface padcet instance 

MediaLink protocol. The generic methods 606 and 608 of an 227 notifying it of the diange in value. The platform 

interface packet object provide for communication between operating services of VNOS 78 then cause the processor 41 

the interface packet object 107 and the related DCE object 50 of device interface 35 to transform the outgoing packet 

109. instance 227 into an outgoing packet. The device interface 

DCE objects 109 serve to interpret, store and perhaps 35 then sends the packet to the personal computer 20 via the 

further manipulate the value represented by the control 29a bus network 28. It will be appredated that in the case of a 

or display 29^? of a device 21. DCE object data 622 com- display 29b rather than a control, where an aspect of a device 

prises the value represented by a control or display. 55 is being monitored, the device interface 35 constantly sends 

Consequently, when a feature control or display is packets to the personal computer 20. What occurs when the 

effectuated, DCE object data 622 changes accordingly. The packet is received by the personal computer 20 is described 

data value may undergo further manipulation as provided by above, 
the DCE object class-specific methods 624. For example, a 

DCE object dass-spedfic method 624 may further change a eo ^ preferred embodiments of the invention have 

value by executing a scaling function on the value or ^teen illustrated and described, it will be appreciated that 

converting a numerical value to a textual value. Code is various changes can be made therein without dqjarting from 

loaded into the class-specific methods of DCE object 109 by the spirit and scope of the invention. Accordingly, it is not 

the platform operating services provided by the portion of intended that the scope of the invention be limited by the 

VNOS 78 located in the device interface 35. 65 disdosure of the prefcared embodiments described above. 

As noted above, by definition, an instance is a specific Instead, the invention should be determined entirdy by 

object with the behaviors defined by its class. An instance reference to the daims that follow. 
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The embodiments of the invention in which an exclusive tfiat rqjresents the adjustment of the visual device control 

fffoperty or privilege is claimed are defined as follows: and without gr^hically altering the visual device control. 

1. A graphical control system for controlling at least one 6. The graphical control system of claim 3, wherein the 
nonncomputer system device, the graphical control system visual network operating system enables the user to create a 
compnsmg: 5 plurality of dones of the visual device control so that each 

(a) a communication medium; clone graphicaUy represents the feature control each done 

(b) a computer coupled to the communication medium, having the same associated data as the visual device control, 
the conq)uter induding a display, aprocessor, a storage 7. jhe grj^hical control system of claim 1, wherein the 
medium and a user manipulation device; visual device control has an adjustable visual device control 

(c) an interface for coupling the non-conqiuter system 10 element, wherdn the adjustable visual device control de- 
device to the communication medium, the interface ment moves Unearly, and wherdn the adjustable visual 
induding an interface processor and an interface stor- device control dement moves vertically when a hdght of the 
age medium; and visual device control is greater than a widtii of the visual 

(d) a visual network operating system for controlling and device control. 

monitoring operation of the computer and the interface 15 8. The graphical control system of claim 7» wherein the 

by: visual device control dement of the visual device control 

(i) causing the computer to display an adjustable visual moves horizontally when the width of the visual device 

device control, the visual device control graphically control is greater than the height of the visual device control 

representing a feature control of a type normally 9. The graphical control system of claim 8, wherein the 

associated with the non-computer system device, the 20 visual network operating system: 

visualdevicecontrolhavingassociateddatastoredin (a) enables the user to increase the width of the visual 

the computer storage medium that represents the device control, while decreasing the height of the visual 

adjustment of the visual device control; device control by operating the user manipulation 

(n) enabhng a user to adjust the visual device control by device- and 

operating the user mani^ation device upon the 25 automatically regenerate the 

visual device control and effectuating a change in the ^ . , j . wmpmci lu auu^iuiiu^auy icgcucrdic wc 

Hoto thot .^.^c^ntc fu^ .Au.^^Z^ , V 1 visual device control so that the adjustable visual 

ScfcS ^^J"^'^* °f v^^"^ device control dement of the visual device control 

(iii) communicating the diange in the data thatrcpre- ' moveshorizontaUy when&e^dthof fee W 

* *u J- r ^^B^^ uiaiicpic control becomes greater than the height 

SlSaT^^^^^^ ' 10. TliegrapMcal control syTm of c^^^^ 

(iv) causing th; interface to adjust the non-computer °"^°^^J^P^^S system: 

system device in accordance with the diange in the (a) enables tiie user to mcrease the height of the visual 

data that represents the adjustment of the visual device control, while decreasing the width of the visual 

device control; 35 device control by operating the user manipulation 

(v) detecting an adjustment to the feature control asso- device; and 

dated with the non-con^uter system device, the causes the computer to automatically regenerate the 

feature control having associated data stored in the visual device control so that the adjustable visual 

interface storage medium that represents the adjust- device control element of the visual device control 

ment to the feature control; 40 moves vertically when the height of the visual device 

(vi) effectuating a change in the data that represents the control becomes greater than the width, 
adjustment of the feature control; Tb® gr^hical control system of daim 1, wherein the 

(vii) communicating the change in the data representing visual network operating system causes the computer to 
the adjustment of the feature control to the computer; display a template visual device control, the template visual 
and 45 device control graphically representing a hypothetical fea- 

(viii) causing the computer to regenerate any visual ture control of the type normally associated with a hypo- 
device control representing the feature control in thetical non-computer system device. 

accOTdance with the change in the data that repre- graphical control system of claim 11, wherein the 

sents the adjustment of the feature control. ^sual network operating system enables tiie user to create 

2. The graphical control system of daim 1, wherein the 50 ^ adjustable master visual device control from the teii^)late 
visual network operating system enables the user to pre- ^^sual device control by operating the user manipulation 
define a function for further manipulating tiie change in data device, the master visual device contrd graphically repre- 
that represents the adjustment of the visual device control. senting the hypothetical feature control, tiie master visual 

3. The graphical control system of daim 2, wherein tiie device control having associated data stored in said corn- 
visual network operating system enables the user to create a 55 storage medium that represents tiie adjustment of tiie 
done of tiie visual device control which also graphically master visual device control. 

represents tiie feature control, wherein tiie clone has tiie The graphical omtrol system of daim 12, wherein tiie 

same assodated data stored in the co^^)uter storage medium visual network operating system enables the user to govern 

as the visual device control the visual device control using the master visual device 

4. The graphical control system of daim 3, wherein the 60 ^^^^^^^ol by: 

visual network operating system enables tiie user to effec- (a) enabling the user to graphically create an interaction 

tuate a change in the data that represents the adjustment of between tiie visual device control and tiie master visual 

tile visual device control by qierating the user manipulation device control by operating the user manipulation 

device upon tiie clone. device; 

5. The graphical control system of daim 3, wherein tiie 65 (b) as a result of tiie interaction, esUblishing a relationship 
visual network operating system enables the user to graphi- between tiie master visual device control and tiie visual 
cally alter the clone witiiout effectuating a change in tiie data device control so that; 



04/23/2004, EAST Version: 1.4.1 



5,6! 

31 

(i) operating the uscx manipulation device upon the 
master visual device control effectuates a change in 
the data representing the adjustment of the master 
visual device control; and 

(ii) the change in the data representing the adjustment 
of the master visual device control effectuates a 
similar change in the data representing the adjust- 
ment of the visual device control. 

14. The graphical control system of claim 13, wherein the 
visual network operating system enables the user to govern 
a plurality of visual device controls using the master visual 
device control. 

15. The graphical control system of claim 12, wherein the 
visual network operating system enables the user to pre- 
define a function for further manipulating the change in data 
representing the adjustment of the master visual device 
control so that the manipulated change in the data repre- 
senting the adjustment of the master visual device control 
effectuates a similar manipulated change in the data repre- 
senting the adjustment of the visual device control. 

16. The graphical control system of claim 1, wherein the 
visual network operating system employs an object-oriented 
programming paradigm in which a plurality of objects are 
used to control the computer, and wherein the objects are 
interoperable and organized into classes in a hierarchical 
fashion. 

17. The graphical control system of claim 16, wherein five 
types of objects are eiiq)loyed by the visual network oper- 
ating system for controlling the computer, the five types of 
objects coir^rising: 

(a) a window object containing the data and methods 
necessary to display a window on the display of the 
computer; 

(b) a visual reference object containing the data and 
methods necessary for displaying the visual device 
control in the window; 

(c) a value control element object containing the data 
representing the adjustment of the visual device 
control, and methods necessary for interpreting and 
storing the data representing the adjustment of the 
visual device control; 

(d) a device object containing the data and methods 
necessary for communicating with the non-computer 
system device and for managing a graphical represen- 
tation of the non-computer system device on the dis- 
play of the computer; and 

(e) a packet object containing the data and methods 
necessary for communicating the change in data that 
represents the adjustment of the visual device control to 
the interface. 

18. The graphical control system of claim 17, wherein 
each type of object may be divided into lower order sub- 
classes of objects. 

19. The graphical control system of claim 17, wherein the 
visual reference object further contains the data and methods 
necessary for displaying an icon representing the non- 
computer system device in a window on the display of the 
computer. 

20. The graphical control system of claim 17, wherein the 
methods of each of the five types of objects further comprise 
generic methods and class-specific methods. 

21. The graphical control system of claim 20, wherein the 
visual network operating system enables the user to load the 
device object* value control element object and visual ref- 
erence object with the class-specific methods. 

22. The graphical control system of claim 20, wherein the 
genetic methods provide for translation of the data contained 
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by the window object, visual reference object and packet 
object into text that is stored in the computer storage 
medium. 

23. The graphical control system of daim 20, wherein the 
5 genetic methods provide for communication between the 

five types of objects. 

24. The graphical control system of daim 20, wherein the 
genetic methods provide for storage of the data contained by 
the window object, visual reference object and device object 
in the computer storage medium when the computer is 
disabled 

25. The graphical control system of daim 24, wherein the 
genetic methods provide for restoration of the data contained 
by the window object, visual reference object and device 
object from the computer storage medium when the com- 

15 puter is enabled. 

26. The graphical control system of daim 20, wherein the 
class-specific methods of the window object provide for 
placement of the visual device control in the window 
displayed on the display of the computer. 

20 27. The graphical control system of daim 20, wherein the 
class-specific methods of the visual reference object provide 
for unique graphical regeneration of the visual device con- 
trol. 

28. The graphical control system of daim 20, wherein the 
25 class-spedfic methods of the value control element object 

provide for further manipulation of the data representing the 
adjustment of the visual device control. 

29. The graphical control system of daim 20, wherein the 
class-spedfic methods of the value control dement object 

30 provide the logic for governing the visual device control 
using another visual device control, 

30. The graphical control system of daim 20, wherein the 
class-spedfic methods of the device object provide for 
managing a graphical representation of the non-computer 

35 system device in the window. 

31. The graphical control system of daim 20, wherein the 
class-spedfic methods of the packet object provide for 
communication of the data representing the adjustment of 
the visual device control between the computer and the 

40 interface of the non-coiiq)Uter system device via the com- 
munication medium. 

32. The graphical control system of daim 1, further 
comprising a plurality of interfaces for coupling a plurality 
of non-computer system devices to the conmiunication 

45 medium so that the graphical control system controls a 
plurality of non-computer system devices, 

33. The graphical control system of claim 1, wherein the 
visual network operating system causes the computer to 
display a plurality of adjustable visual device controls, each 

50 visual device control graphically representing a feature 
control of a type normally associated with the non-computer 
system device, each visual device control having associated 
data stored in the conq)Uter storage medium that represents 
the adjustment of the visual device control. 

55 34. The graphical control system of claim 1, wherein the 
communication medium is a network. 

35. The graphical control system of claim 1, wherein the 
communication medium is a point-to point connection 
between a computer and a single non-computer system 

60 device. 

36. The graphical control system of claim 1, wherein the 
visual network operating system employs an object-oriented 
programming paradigm in which a plurality of objects are 
used to control the interface. 

65 37. The graphical control system of daim 36. wherein two 
types of objects are used for controlling the interface, said 
two types of objects con^rising: 
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(a) a device control element object containing the data 43. The method of claim 42. further con^sing prede- 
reiH'esentmg the adjustment of the feature control, and fining a function for further manipulating the change in data 
methods necessary for further interpreting and storing that represents the adjustnient of ^e graphical control before 
the data rq}resenting the adjustment of the feature communicating the change in data to the interface, 
control; and 5 44, Tlie method of claim 43, wherein enabling the user to 

(b) anintcrfacepacketobjectcontainingdataandmethods ^f^^^^ tiie graphical control further comprises creating a 
necessary for communicating the change in data that ^^^^ the graphical control so that the clone graphically 
represents the adjustment of the feature control to the '^P'^^f^^ ^^^^ control the clone having the same 
comouter associated data as the graphical control. 

io JtT 1 t * if t • 1. . t. The method of claim 44, wherein aeating the done 

38. The graphical control system of claim 37, wherem the lO ^,^1,^ *«oki:«« *, * u • 

A c^i, *^ ^ X . r.^u . further conqjnses enabling the user to effectuate a change m 

methodsofeachof^etwotypesofobjectsfurthercompnse t^e data that represents the adjustment of the gr^hical 

dass-speofic methods. ^^^trol by operating the user manipulation device upon the 

39. The graphical control system of claim 38, wherein the done. 

visual netwcffk operating system enables the user to load the 45. The method of daim 45, wherein aeating the done 

class-specific methods into the device control element 15 further coni^rises enabling the user to graphically alter the 

object. done in accordance with a predefined function, wherein the 

40. The graphical control system of claim 39, wherein the predefined function does not effectuate a change in the data 
class-specific methods of the device control element object that represents the adjustment of the graphical control, and 
provide for further manipulation of the data representing the wherein the predefined function does not graphically alter 
adjustment of the feature control. 20 the graphical control. 

41. The graphical control system of claim 39, wherein the 47. The method of claim 44, wherein enabling the user to 
dass-spedfic methods of the interface packet object provide adjust the graphical control further comprises creating a 
for communication of the data representing the adjustment plurality of dones of the graphical control so that each done 
of the feature control between the interface and the computer graphicaUy represents the feature control, each clone having 
via the communication medium. 25 same assodated data as the graphical control 

42. A method for controlling at least one non-conmuter , ^^^^ °^ "^^^ con^sing causing 
system device including at least one device control, the computer to display a template graphical control, said 
device control governing an aspect of the non-computer [^Plate graphical control graphically representing a hypo- 
system device, wherdn the non-computer system device is ^^^^^^ ^ ^ """"^y associated with a 
coupled to a communication medium by an interface and 30 hypothetical non-computer system device. 

connected via the communication medium to a computer ^^^^ ^' con^nsing enabling 

system, wherdn the computer system comprises a display, a ?! "'f ^f^*^ ^ adjustable master graphical contrd 

processor, a storage medium and a user manipulation device, template graphical contrd by operating the user 

the method comprising: mampulation device, tiie master graphical control gr^hi- 

/V • * • J- 1 1 ^ 1 35 cally representing the hypoth^cal feature control, the mas- 

^ ^^^rlia^T^ a graphical control 35 ^ ^1^^ ^^^^ ^ ^^^^ ^ ^ ^ 

X^r^T ? f, 'T"* '=<4«Jter storage medium ttat represents the adjustment of 

the graphical control display havmg at least one ad^ the faster gra^ucal control. 

inJ'X^^l control thegraphical control K^resent- 5„ „f ^^45 comprising enabling 

ngafeature control of at^cnonnidlyassoaa^ed with ^^^^ ,^ ^ ^ | | 

the non-conmuter system device, the graphical control ^ «^«„ui„„i „u^' uv *u f 

. . • ♦ J J * * J • *u * . gr^hical control, wherem enabling the user to use the 

having associated data stored m the conmuter storage 1,1*1^ ^ t.* t *. i • 

J* *L X ^ .1- J. ^ ^ ^* , master graphical control comnnses: 

medium that represents the adjustment of tiie graphical ^!T. „ 

control- enabimg the user to graphically create an mteraction 

«^ ^ A' 4. 4.U u- 1 *_ 1 u between the graphical control and the master grM)hical 

(b) enabimg a user to adjust the grat^cal control by u,. \: *t. • i j • 

*u . 1 ^ . , 45 control by operating the user manipulation device; 

operating tiie user mampulaUon device upon the « . . f ^ ^Tf^, , , V. 

graphical contrd and effecmating a diangc in the data (b) as a resdt of tiie mtemction, estabhslung a relationship 

tiiat represents tiie adjustment of tiie graphical contrd; ^^^^ ^^P^^ ^^"^^^ 

(c) communicating the diange in the data that represents ' i. ^ , ^. r.^ ^ ^ 

tiie adjustment of tiie graphical control to tiie interface; ^ t '^"^^ rehtionship between tiie niaster 

(d) causing tiie interface to adjust tiie non-computer '° ^^^^^ ^ ? i? ^'^wf ' '"^'^^^ 

X J . . , .:. , . . . , the user to effectuate a dianse in the data renresentine 

system device in accordance witii the change in tiie data f ,u V i7 i u 

*u ^ * * *u u* 1 *_ 1 adjustment of tiie master graphical control by 

ti^at represents tiie adjustment of tiie graphical contro ; manipulation device, wherein tiie 

(e) detecting an adjustment to tiie feature control assoa- change in data representing tiie adjustment of tiie 
ated with tiie non-computer system deface tiie featu^^ 55 ^^^^^^ effectuates a similar 
control having associated data stored in tiie mterface change in tiic data representing tiie adjustment of ttie 
storage, medium tiiat represents an adjustment of the graphical control 

feature control; 51 metiiod of claim 50, wherein enabling tiie user to 

(f) effectuating a change m tiie data tiiat represents tiie effectuate a change in tiie data representing the adjustment 
adjustment of tiie feature control when tiie adjustment ^ of master graphical contrd further con^rises enabling 
to ttie feature control is detected; the user to predefine a fundion for additionally manipulating 

(g) communicating ttie change in tiie data representing tfie tiie change in ttie data representing the adjustment of ttie 
adjustment of the, feature control to the coII^>uter; and master graphical control. 

(h) causing the computer to regenerate any graphical 52. The metiiod of daim 49, further comprising enabling 
controls representing the feature control in accordance 65 the user to use the master graphical control to govern a 
witii the change in the data tfiat represents Uie adjust- plurality of graphical controls, wherein enabling the user to 
ment of the feature control. use the master graphical control conqirises: 
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for each graphical control, 

(a) enabling the user to graphically create an interaction 
between the master graphical control and the graphi- 
cal control by operating the user manipulation 
device; 

(b) as a result of the interaction, establishing a rela- 
tionship between the master graphical control and 
the graphical control; 

(c) as a result of the relationship between the master 
graphical control and the graphical control enabling 
the user to effectuate a change in the data represent- 
ing the adjustment of the master graphical control by 
operating the user manipulation device, wherein the 
change in data representing the adjustment of the 
master graphical control also effectuates a similar 
change in the data representing the adjustment of the 
graphical control. 

53. The method of claim 42, further comprising: 

(a) causing the computer to display the graphical control 
display representing the non-computer system device, 
the graphical control display having a plurality of 
adjustable graphical controls, each graphical control 
representing a feature control of a type normally asso- 
ciated with the non-computer system device, each 
graphical control having associated data stored in the 
computer storage medium that represents the adjust- 
ment of eadi graphical control; and 

(b) enabling a user to adjust each graphical control by 
operating the user manipulation device upon each 
graphical control and effectuating a change in the data 
that represents the adjustment of each graphical con- 
trol. 

54. The method of claim 42, further comprising prede- 
fining a function for further manipulating the change in data 
representing the adjustment of the feature control before 
communicating the change in data to the computer system. 

55. The method of claim 42, further comprising causing 
the coir^uter to display a plurality of graphical control 
display each graphical control displays representing at least 
one of a plurality of non-computer system devices, wherein 
each non-computer system device is coupled to the com- 
munication medium by an interface. 

56. A graphical control system for controlling at least one 
non-computer system device, the graphical control system 
comprising: 

(a) a conmiunication medium; 

(b) a computer coupled to the communication medium, 
the computer including a display, a processor, a storage 
medium and a user manipulation device; 

(c) an interface for coupling the non-con^)Uter system 
device to the communication medium, the interface 
including an interface processor mad an interface stor- 
age medium; and 

(d) a visual network operating system for controlling and 
monitoring operation of the computer and the interface 
by: 

(i) causing the computer to display an adjustable visual 
device control, the visual device control graphically 
representing a feature control of a type normally 
associated with the non-computer system device, the 
visual device control having associated data stored in 
the computer storage medium that rq)resents the 
adjustment of the visual device control; 

(ii) enabling a user to adjust the visual device control by 
operating the user manipulation device upon the 
visual device control and effectuating a change in the 
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data that represents the adjustment of the visual 
device control; 

(iii) conmuinicating the change in the data that repre- 
sents the adjustment of the visual device control to 

5 the interface; 

(iv) causing the interface to adjust the non-computer 
system device in accordance with the change in the 
data that represents the adjustment of the visual 
device control; and 

10 (v) causing the computer to display a template visual 
device control, the template visual device control 
graphically representing a hypothetical feature con- 
trol of a non-computer system device that is not 
controlled and monitored by the visual network 
15 operating systenL 

57. The graphical control system of claim 56, wherein the 
visual network operating system enables the user to create 
an adjustable master visual device control from the template 
visual device control by operating the user manipulation 
20 device, the master visual device control graphically repre- 
senting the hypothetical feature control, the master visual 
device control having associated data stored in said com- 
puter storage medium that represents the adjustment of the 
master visual device control. 
25 58. The graphical control system of claim 57, wherein the 
visual network operating system enables the user to govern 
the visual device control using the master visual device 
control by: 

(a) enabling the user to graphically create an interaction 
30 between the visual device control and the master visual 

device control by operating the user manipulation 
device; 

(b) as a result of the interaction, establishing a relationship 
between the master visual device control and the visual 
device control so that: 

(i) operating the user manipulation device upon the 
master visual device control effectuates a change in 
the data representing the adjustment of the master 
visual device control; and 
^ (ii) the change in the data representing the adjustment 
of the master visual device control effectuates a 
similar change in the data representing the adjust- 
ment of the visual device control. 

59. The graphical control system of claim 58, wherein the 
visual network operating system enables the user to govern 
a plurality of visual device controls using the master visual 
device control. 

60. The graphical control system of claim 57, wherein the 
visual network operating system enables the user to pre- 
define a function for further manipulating the change in data 
representing the adjustment of the master visual device 
control so that the manipulated change in the data repre- 
senting the adjustment of the master visual device control 
effectuates a similar manipulated change in the data rqpre- 
senting the adjustment of the visual device control. 

61. A graphical control system for controlling at least one 
non-computer system device, the graphical control system 
comprising: 

(a) a communication medium; 

(b) a computer coupled to the conmiunication medium, 
the computer including a display, a processor, a storage 
medium and a user manipulation device; 

(c) an interface for coupling the non-computer system 
65 device to the communication medium, the interface 

including an interface processor and an interface stor- 
age medium; and 
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(d) a visual network opexating system for controlling and 
monitoring operation of the computer and the intrface 
by: 

(1) causing the computer to display an adjustable visual 
device control, the visual device control graphically 
representing a feature control of a type normally 
associated with the non-computer system device, the 
visual device control having associated data stored in 
the computer storage medium that represents the 
adjustment of the visual device control; 

(ii) enabling a user to adjust the visual device control by 
operating the user manipulation device upon the 
visual device control and efifectuating a change in the 
data that rq)resents the adjustment of the visual 
device control; 

(iii) communicating the change in the data that repre- 
sents the adjustment of the visual device control to 
the interface; 

(iv) causing the interface to adjust the non-computer 
system device in accordance with the change in the 
data that represents the adjustment of the visual 
device control; and 

(v) enabling the user to create a clone of the visual 
device control which also graphically represents and 
controls the feature control, wherein the clone has 
the same associated data stored in the computer 
storage medium as the visual device control 

62. The graphical control system of claim 61, whereia the 
visual network operating system enables the user to effec- 
tuate a change in the data that represents the adjustment of 
the visual device control by operating the user manipuiation 
device upon the clone. 

63. The graphical control system of claim 61, wherein the 
visual network operating system enables the user to graphi- 
cally alter the clone without effectuating a change in the data 
that represents the adjustment of the visual device control 
and without graphically altering the visual device control. 

64. The graphical control system of claim 61, wherein the 
visual network operating system enables the user to create a 
plurality of clones of the visual device control so that each 
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(c) communicating the change in the data that represents 
the adjustment of the graphical control to the interface; 

(d) causing the interface to adjust the non-computer 
system device in accordance with the change in the data 
that represents the adjustment of the graphical control; 
and 

(e) causing the computer to display a tenq)late graphical 
control, said template graphical control graphically 
rqiresenting a hypothetical feature control of a non- 
computer system device that is not connected to the 
communication medium. 

67. The method of daim 66, further comprising enabling 
the user to create an adjustable master graphical control 
from tiie tenqjlate graphical control by operating the user 
manipulation device, the master graphical control graphi- 
cally representing the hypothetical feature control, the mas- 
ter graphical control having associated data stored in said 
computer storage medium that represents the adjustment of 
the master graphical control 

68. The metiiod of daim 67, further comprising enabling 
the user to use the master graphical control to govern the 
gr^hical control, wherein enabling the user to use the 
master graphical control comprises: 

(a) enabling the user to graphically create an interaction 
between the gr^hical control and the master graphical 
control by operating the user manipulation device; 

(b) as a result of the interaction, establishing a rclationsh^) 
between the master graphical control and the graphical 
control; 

(c) as a result of the relationship between the master 
graphical control and the gr^hical control, enabling 
the user to effectuate a change in the data representing 
the adjustment of the master graphical control by 
operating the user manipulation device, wherein the 
change in data representing the adjustment of the 
master graphical control also effectuates a similar 
change in the data representing the adjustment of the 
graphical control. 

69. The method of claim 68, wherein enabling the user to 



done graphically represents the feature control each done 40 effectuate a change in the data representing the adjustment 



having the same assodated data as the visual device control 

65. The graphical control system of claim 61, wherein the 
visual network operating system enables the user to pre- 
define a function for further manipulating the diange in data 
that represents the adjustment of the visual device control. 

66. A method for controlling at least one non-computer 
system device including at least one device control, the 
device control governing an aspect of the non-computer 
system device, wherein the non-computer system device is 
coupled to a communication medium by an interface and 
connected via the communication medium to a computer 
system, wherdn the computer system comprises a display, a 
processor, a storage medium and a user man^)ulation device, 
the method conpnsing: 

(a) causing the computer to display a graphical control 
display representing the non-cora^uter system device, 
the graphical control display having at least one adjust- 
able graphical control the graphical control represent- 
ing a feature control of a type normally associated with 
the non-computer system device, the gr£q)hical control 
having assodated data stored in the con^uter storage 
medium that represents the adjustment of the gr^hical 
control; 

(b) enabling a user to adjust the graphical control by 
operating the user manipulation device upon the 65 
graphical control and effectuating a diange in the data 
that represents the adjustment of the graphical control; 
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of the master gr^hical control further comprises enabling 
the user to predefine a function for additionally manq)ulating 
the change in the data representing the adjustment of the 
master graphical control 

70. The method of daim 68, further comprising enabling 
the user to use the master graphical control to govern a 
plurality of graphical controls, wherdn enabling the user to 
use the master graphical control comprises: 

for each graphical control, 

(a) enabling the user to graphically create an interaction 
between the master graphical control and the graphi- 
cal control by operating the user manipulation 
device; 

(b) as a result of the interaction, establishing a rda- 
tionship between the master graphical control and 
the graphical control; 

(c) as a result of the relationship between the master 
graphical control and the graphical control, enabling 
die user to effectuate a change in the data represent- 
ing the adjustment of the master graphical control by 
operating the user manipulation device, wherein the 
change in data rq)resenting the adjustment of the 
master graphical control also effectuates a similar 
diange in the data representing the adjustment of the 
graphical control 

71. A method for controlling at least one non-computer 
system device induding at least one device control, the 
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device control governing an aspect of the non-computer (e) creating a clone of the graphical control which along 

system device, wherein the non-computer system device is with the graphical control graphically represents and 

coupled to a communication medium by an interface and ^^^^^^ ^^^^ ^^^^^^ ^^^^ having the same 

connected via the commumcation medium to a computer . j ^ * v i ^ i 

system, wherein the computer system comj^ses a display, a ^ assoaated data as the graphical control, 

processor, a storage medium and a user manipulation device, 72, The method of claim 71, wherein creating the clone 

the method comprising: further conq)rising enabling the user to effectuate a change 

(a) causing the computer to display a graphical control in the data that represents the adjustment of the graphical 
display representing the non-computer system device, control by operating the user manipulation device upon the 
the graphical control display having at least one adjust- . 

able graphical control, the graphical control represent- ' , ^ ^ , . «^ t . . ,.1 

ing a feature control of a type normally associated with 73. The method of daim 72, wherem creatmg the clone 

the, non-computer system device, the graphical control further comprising enabling the user to graphically alter the 

having associated data stared in the con^uter storage clone in accordance with a predefined function, wherein the 

medium that represents the adjustment of the graphical predefined function does not effectuate a change in the data 

control; 15 represents the adjustment of the graphical control, and 

(b) enabling a user to adjust the graphical control by wherein the predefined function does not graphically alter 
operating the user nmnipulation device .upon the ^ 

graphical control and effectuating a change in the data ~TrX j r 1 • t. • *u 

Sat represents the adjustment of the graphical control; 74. Hie method of claim 71 wherem enabhng the user to 

(c) communicating the change in the data that represents 20 ^^J"^ the graphical control furtiier compnses creatmg a 
the adjustment of the graphical control to the interface; plurahty of clones of the graphical control so that each done 

(d) causing the interface to adjust the non-con^uter graphically represents the feature control, each clone having 
system device in accordance with the change in the data same associated data as the graphical control. 

that represents the adjustment of the graphical control; 

and ***** 
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line 2) 


"genetic" should read -generic-- 
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5 

line 2) 


"genetic" should read -generic-- 
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(Claim 24, 


8 

line 2) 


"genetic" should read —generic— 
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(Claim 25, 


13 

line 2) 


"genetic" should read —generic- 
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(Claim 42, 


57 

line 31) 


After "storage" please delete the 


33 

(Claim 42, 


63 
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After "adjustment of the" please delete the 
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